Free Tool

robots.txt Generator & Tester

Generate, preview, and test robots.txt files. Check if URLs are allowed or blocked.

Presets

Rule 1

User-Agent

Allow

Disallow

Crawl-Delay (sec)

Sitemaps & Host

Sitemap URLs

Host (optional)

Want deeper insights?