# Googlebot

Bot · Crawlers · Builds a search index · operated by google

**Identity:** Publishes its IP addresses.

## How to recognise it

- Published IP list: https://developers.google.com/static/crawling/ipranges/common-crawlers.json
- Reverse DNS ends in `googlebot.com`, `google.com`, `googleusercontent.com` (then forward-confirm)
- User agent contains `Storebot-Google`, `Google-InspectionTool`

## Allow or block

To opt out, add to robots.txt:

```robots
User-agent: Googlebot
Disallow: /
```

## With Double Agent

Sessions from Googlebot are labelled `bot` with `agent_id: google.googlebot`, and tagged in your analytics. Nothing is blocked unless you choose to. Install: https://doubleagent.so/install.md

Source: https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers · Operator docs: https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers