Identity: Names itself in its user agent only.
How to recognise it
- User agent contains
Bytespider,TikTokSpider,DoubaoBot
Allow or block
To opt out, add to robots.txt:
User-agent: Bytespider
Disallow: /It may not honour robots.txt, because a person asked for the page.
With Double Agent
Sessions from Bytespider are labelled bot with agent_id: bytedance.bytespider, and tagged in your analytics. Nothing is blocked unless you choose to. Install: https://doubleagent.so/install.md
Source: https://github.com/ai-robots-txt/ai.robots.txt