Directory Crawlers

ShapBot Bot

Builds a search index. Operated by parallel.

Identity: Publishes its IP addresses.

How to recognise it

  • Published IP list: https://docs.parallel.ai/resources/shapbot.json
  • User agent contains ShapBot, Shap-User

With Double Agent

Sessions from ShapBot are labelled bot with agent_id: parallel.shapbot, and tagged in your analytics. Nothing is blocked unless you choose to. Install: https://doubleagent.so/install.md

Source: https://docs.parallel.ai