Directory Crawlers

coccocbot Bot

Builds a search index. Operated by coccoc.

Identity: Names itself in its user agent only.

How to recognise it

  • Nothing reliable: Double Agent detects it by behaviour and environment

With Double Agent

Sessions from coccocbot are labelled bot with agent_id: coccoc.coccocbot, and tagged in your analytics. Nothing is blocked unless you choose to. Install: https://doubleagent.so/install.md

Source: https://github.com/monperrus/crawler-user-agents