Robots.txt Generator
Generate a valid robots.txt file with user-agent, allow, disallow and sitemap rules. Free online generator with copy-ready output.
Preparing private browser tool…
Frequently asked questions
- Where should robots.txt live?
- At the root of your domain, e.g. https://example.com/robots.txt. Search engines only look for it at that exact path.
- Does Disallow guarantee privacy?
- No. robots.txt is only a polite request. Well-behaved crawlers obey it, but use real authentication for private pages.
- Include Sitemap line?
- Yes. Adding a Sitemap directive helps search engines discover all pages. Use an absolute URL.