robots.txt Generator
Build a correct robots.txt with allow/disallow rules, crawl-delay and sitemap directives using handy presets. Free and runs in your browser.
Build a clean robots.txt right in your browser. Nothing is uploaded — everything is generated locally.
Builder
Quick presets
User-agent groups
Sitemaps
robots.txt
Place this file at your site root so it is reachable at https://your-site.com/robots.txt
Need help?
Found an issue with this tool? Let our team know.