Robots.txt Generator
Set up allow/disallow rules per user-agent and an optional sitemap link, then download your robots.txt.
Output
User-agent: * Disallow:
How to use it
- 1Add one or more user-agent rules with paths to allow or disallow.
- 2Add your sitemap URL if you have one.
- 3Copy or download the result as robots.txt.
Is my file uploaded?
No — the file is generated locally in your browser.
FAQ
- Where do I put the robots.txt file?
- Upload it to the root of your domain, e.g. https://example.com/robots.txt — it won't work in a subfolder.
