Directory
Find an agent.
Agents that publish an A2A Agent Card: what each one does, how to call it, and how far to trust it.
Search is unavailable right now. The catalog of crawlers and bots is below.
Crawlers, bots and libraries we detect
The catalog: 226 clients named by user agent, IP list or signature
124 of 226 clients
Assistants fetching for a user 11
Fetched because a person asked an assistant.
- DiscordbotBotIdentity: User agent
- EmbedlyBotIdentity: User agent
- facebookexternalhitBotIdentity: User agent
- IframelyBotIdentity: User agent
- LinkedInBotBotIdentity: User agent
- redditbotBotIdentity: User agent
- SlackbotBotIdentity: User agent
- Snap URL PreviewBotIdentity: User agent
- TelegramBotBotIdentity: User agent
- TwitterbotBotIdentity: User agent
- WhatsAppBotIdentity: User agent
Crawlers 95
Crawl the web for training, search or data.
- 360SpiderBotIdentity: User agent
- AddSearchBotBotIdentity: User agent
- AgentTimesBotIdentity: User agent
- AI2BotBotIdentity: User agent
- aiHitBotBotIdentity: User agent
- AIWebIndexBotIdentity: User agent
- Amazon AI services (Kendra, Q Business, Bedrock)BotIdentity: User agent
- AmazonbotBotIdentity: User agent
- Amzn-SearchBotBotIdentity: User agent
- AndibotBotIdentity: User agent
- AnomuraBotIdentity: User agent
- Aranet-SearchBotBotIdentity: User agent
- AtlassianBotIdentity: User agent
- AwarioBotIdentity: User agent
- AzureAI-SearchBotBotIdentity: User agent
- BarkrowlerBotIdentity: User agent
- Better StackBotIdentity: User agent
- bigsur.aiBotIdentity: User agent
- BLEXBotBotIdentity: User agent
- BrandwatchBotIdentity: User agent
- BravebotBotIdentity: User agent
- BrightbotBotIdentity: User agent
- BrightEdgeBotIdentity: User agent
- BytespiderBotIdentity: User agent
- Channel3BotBotIdentity: User agent
- ChatGLM-SpiderBotIdentity: User agent
- coccocbotBotIdentity: User agent
- CohereBotIdentity: User agent
- CotoyogiBotIdentity: User agent
- CragCrawlerBotIdentity: User agent
- CrawlspaceBotIdentity: User agent
- DataForSeoBotBotIdentity: User agent
- Datenbank CrawlerBotIdentity: User agent
- DeepSeekBotBotIdentity: User agent
- DiffbotBotIdentity: User agent
- DotBot / rogerbotBotIdentity: User agent
- EchoboxBotIdentity: User agent
- ERNIEBotIdentity: User agent
- FactSetBotIdentity: User agent
- FriendlyCrawlerBotIdentity: User agent
- GrokBotIdentity: User agent
- GTmetrixBotIdentity: User agent
- HenkBotBotIdentity: User agent
- iAskBotIdentity: User agent
- ICC-CrawlerBotIdentity: User agent
- ImagesiftBotBotIdentity: User agent
- imageSpiderBotIdentity: User agent
- img2datasetBotIdentity: User agent
- ISS Cyber RiskBotIdentity: User agent
- Kangaroo BotBotIdentity: User agent
- KimiBotBotIdentity: User agent
- KunatoCrawlerBotIdentity: User agent
- LighthouseBotIdentity: User agent
- LingueeBotIdentity: User agent
- MeltwaterBotIdentity: User agent
- Meta-WebIndexerBotIdentity: User agent
- MistralAI-TrainingBotIdentity: User agent
- MJ12botBotIdentity: User agent
- MojeekBotBotIdentity: User agent
- MyCentralAIScraperBotBotIdentity: User agent
- NagetBotBotIdentity: User agent
- netEstateBotIdentity: User agent
- New Relic SyntheticsBotIdentity: User agent
- newsaiBotIdentity: User agent
- PanscientBotIdentity: User agent
- PetalBotBotIdentity: User agent
- PoseidonBotIdentity: User agent
- QueritBotIdentity: User agent
- QuillBotBotIdentity: User agent
- QwantbotBotIdentity: User agent
- QwenBotIdentity: User agent
- ReflectionbotBotIdentity: User agent
- SBIntuitionsBotBotIdentity: User agent
- Screaming FrogBotIdentity: User agent
- SE RankingBotIdentity: User agent
- SeekportBotBotIdentity: User agent
- SemrushBotBotIdentity: User agent
- SEOkicksBotIdentity: User agent
- serpstatbotBotIdentity: User agent
- SidetradeBotIdentity: User agent
- Site24x7BotIdentity: User agent
- SitebulbBotIdentity: User agent
- SiteimproveBotIdentity: User agent
- Sogou spiderBotIdentity: User agent
- StatusCakeBotIdentity: User agent
- TerraCotta (Ceramic)BotIdentity: User agent
- ThinkbotBotIdentity: User agent
- TimpibotBotIdentity: User agent
- VelenBotIdentity: User agent
- WARDBotBotIdentity: User agent
- WebPageTestBotIdentity: User agent
- Webz.io (omgili)BotIdentity: User agent
- Yahoo SlurpBotIdentity: User agent
- Yeti (Naver)BotIdentity: User agent
- ZanistaBotBotIdentity: User agent
Scraping services 4
Rented scraping, usually disguised.
Automation tools 3
Headless browsers and drivers.
HTTP libraries 11
Scripts with a default user agent.
- aiohttpBotIdentity: User agent
- Apache-HttpClientBotIdentity: User agent
- axiosBotIdentity: User agent
- curlBotIdentity: User agent
- Go-http-clientBotIdentity: User agent
- node-fetchBotIdentity: User agent
- okhttpBotIdentity: User agent
- python-httpxBotIdentity: User agent
- python-requestsBotIdentity: User agent
- Python-urllibBotIdentity: User agent
- WgetBotIdentity: User agent
List your agent
Publish an A2A Agent Card at https://your-domain/.well-known/agent-card.json, then submit your domain or the card URL. We read the card within minutes, and check it again every week.