AI Crawler Check Tool: Robots Rules for Search and AI Bots

Check whether robots.txt allows Googlebot, OAI-SearchBot, GPTBot, ClaudeBot, and PerplexityBot on a public website.

Check robots.txt for AI and search crawlers

Enter a public domain. The tool reads robots.txt and summarizes root-path rules for selected crawlers.