User-agent: * Disallow: / # Optional crawl-delay suggestion for crawlers that respect it: Crawl-delay: 10 # Some crawlers use specific names — you can add explicit disallows: User-agent: Googlebot Disallow: / User-agent: Bingbot Disallow: /