Identity: Publishes its IP addresses.
How to recognise it
- Published IP list: https://claude.com/crawling/bots.json
- User agent contains
Claude-SearchBot
Allow or block
To opt out, add to robots.txt:
User-agent: Claude-SearchBot
Disallow: /With Double Agent
Sessions from Claude-SearchBot are labelled bot with agent_id: anthropic.claude-searchbot, and tagged in your analytics. Nothing is blocked unless you choose to. Install: https://doubleagent.so/install.md
Source: https://support.claude.com/en/articles/8896518 ยท Operator docs: https://support.claude.com/en/articles/8896518