Claude-SearchBot

Claude-SearchBot is Anthropic's crawler dedicated to indexing web content for Claude's search and citation feature, separate from ClaudeBot, which collects training data. It builds the pool of retrievable, citable pages Claude draws on when it grounds an answer in live web sources.

Why it matters

Confirming Claude-SearchBot access, not just ClaudeBot access, is the specific check that determines whether a page can actually be cited by Claude's search feature, making it the more directly relevant crawler for a GEO visibility program than the training-only ClaudeBot.

Related terms

• ClaudeBot

  ClaudeBot is Anthropic's crawler for collecting web content used in training its Claude models, operating separately from Claude-SearchBot, the crawler that builds the index Claude's web search and citation feature actually draws from. As with OpenAI's crawlers, blocking one does not automatically block the other.

• Claude

  Claude is Anthropic's model family, which added a web-grounded search mode that retrieves live pages and cites them alongside a generated answer, structurally similar to ChatGPT Search. Anthropic runs two separate crawlers for it: ClaudeBot collects training data, while Claude-SearchBot builds the separate index that Claude's search feature actually cites from.

• Grounding

  Grounding is when an AI system anchors its generated response in specific retrieved source material, a live web page, a document, a database record, rather than relying only on patterns learned during training. It's what separates a cited answer from an unsupported one.