DevToolkit

Robots.txt Tester

Browser only

Robots.txt Tester

Paste robots.txt content, then test whether a URL or path is allowed for a specific user-agent.

robots.txt

User-agentURL or path

Result

Crawl decision

Ready

Paste robots.txt, enter a user-agent and path, then click Test.

DevToolkit

Browser-based tools for developers, DevOps, self-hosters, and webmasters. No login, no upload, and copy-ready outputs.

Tools Principles Privacy Policy Terms of Use Top