Directory Crawlers

DotBot / rogerbot Bot

SEO research. Operated by moz.

Identity: Names itself in its user agent only.

How to recognise it

  • User agent contains DotBot, rogerbot

With Double Agent

Sessions from DotBot / rogerbot are labelled bot with agent_id: moz.dotbot, and tagged in your analytics. Nothing is blocked unless you choose to. Install: https://doubleagent.so/install.md

Source: https://radar.cloudflare.com/bots/directory