Saemol Tools
Free tools
English
Developer Tools

robots.txt generator

Generate robots.txt rules from a crawler, disallowed paths and sitemap URL. Use it in your browser, with no account required.

No account needed

Loading tool…

How to use

  1. 1Enter your values and choose the options.
  2. 2Run the tool and review the result.
  3. 3Copy the result or save it as a file.

Good to know

Inspect the example output format first. Keep the original separately and check transformed values, spaces and line breaks before using the result.

Ads may process connection data. Personalization follows your privacy choices. Privacy (English)

Worked input and output example

These results come from this tool’s actual engine using the sample values below, not your personal input or saved work. Load the example in the tool to inspect the same inputs.

Example input

FieldValue
Crawler name
*
Disallowed paths (one per line)
/admin/
/private/
Sitemap URL
https://example.com/sitemap.xml

Example result

User-agent: *
Disallow: /admin/
Disallow: /private/
Sitemap: https://example.com/sitemap.xml

Related tools

All tools