Skip to content
Tools By Tari

Robots.txt Generator

Set up allow/disallow rules per user-agent and an optional sitemap link, then download your robots.txt.

Output
User-agent: *
Disallow:

How to use it

  1. 1Add one or more user-agent rules with paths to allow or disallow.
  2. 2Add your sitemap URL if you have one.
  3. 3Copy or download the result as robots.txt.

Is my file uploaded?

No — the file is generated locally in your browser.

FAQ

Where do I put the robots.txt file?
Upload it to the root of your domain, e.g. https://example.com/robots.txt — it won't work in a subfolder.