Identity: Names itself in its user agent only.
How to recognise it
- User agent contains
Crawl4AI
With Double Agent
Sessions from Crawl4AI are labelled bot with agent_id: crawl4ai.crawler, and tagged in your analytics. Nothing is blocked unless you choose to. Install: https://doubleagent.so/install.md
Source: https://github.com/unclecode/crawl4ai