Robots.txt Tester — Free SEO Tool
Fetch & review robots.txt. Get a clear score and recommendations in plain language.
Run Robots.txt Tester
Enter a full page URL to start the analysis.
About this tool
Fetches robots.txt and reviews basic allow/disallow and sitemap lines so you do not block important content by mistake.
Tips for better results
- Use the final public URL (not a staging login page).
- Fix critical issues first, then re-run the same tool.
- Combine this check with the main pillar analyzer for a wider view.