ClaudeBot
Anthropic's crawler used for training Claude models.
ClaudeBot is Anthropic's user agent for crawling the web to train Claude models. Like GPTBot, it respects robots.txt. Anthropic also operates separate user agents for live retrieval in Claude's browsing features.