Directory Crawlers

PerplexityBot Bot

Builds a search index. Operated by perplexity.

Identity: Publishes its IP addresses.

How to recognise it

  • Published IP list: https://www.perplexity.com/perplexitybot.json
  • User agent contains PerplexityBot

Allow or block

To opt out, add to robots.txt:

User-agent: PerplexityBot
Disallow: /

With Double Agent

Sessions from PerplexityBot are labelled bot with agent_id: perplexity.perplexitybot, and tagged in your analytics. Nothing is blocked unless you choose to. Install: https://doubleagent.so/install.md

Source: https://docs.perplexity.ai/guides/bots ยท Operator docs: https://docs.perplexity.ai/guides/bots