Robots.txt Validator & Crawl Tester
Test robots.txt syntax errors, verify Googlebot crawler rules, check sitemap directives, and simulate URL blocking.
URL Block Simulation Tester
Googlebot Crawl Verdict:
Blocked by Disallow: /admin/
Detected Directives
Target User-Agents:
* (All Crawlers)
Disallow Rules:
4 paths blocked
Sitemaps Declared:
2 sitemaps found