Directory Scraping services

ScrapingBee Bot

Collects data. Operated by scrapingbee.

Identity: Doesn’t identify itself.

How to recognise it

  • Nothing reliable: Double Agent detects it by behaviour and environment

With Double Agent

Sessions from ScrapingBee are labelled bot with agent_id: scrapingbee.api, and tagged in your analytics. Nothing is blocked unless you choose to. Install: https://doubleagent.so/install.md

Source: https://www.scrapingbee.com