AI Model Trainer
ClaudeBot (Claude) Access Checker
Anthropic's search crawler utilized to inspect websites and index pages for training Claude models and powering Anthropic features.
Verify Robots.txt blocks for ClaudeBot (Claude)
Enter your domain to run a live AI crawl check auditing user agent directives.
Official User-Agent String
Mozilla/5.0 (compatible; ClaudeBot/1.0; +http://www.anthropic.com/claudebot)Verification Directives
To Block Crawler (Disallow)
User-agent: ClaudeBot Disallow: /
To Allow Crawler (Allow)
User-agent: ClaudeBot Allow: /
ClaudeBot (Claude) Search Optimization FAQs
Q: What is Anthropic's ClaudeBot?
ClaudeBot is the official web scraper for Anthropic, designed to fetch web data for their conversational assistant Claude.
Q: Does ClaudeBot respect robots.txt?
Yes. Anthropic has declared that ClaudeBot strictly adheres to standard robots.txt disallow rules.
Q: Should I block ClaudeBot?
If you want to protect your proprietary articles, data, or documentation from being used in Claude's model training runs, you should block it.