User-Agent: * Disallow: / # Explicitly block some Google crawlers that ignore '*' rule [1] # [1]: https://developers.google.com/crawling/docs/crawlers-fetchers/google-special-case-crawlers User-Agent: APIs-Google Disallow: / User-Agent: AdsBot-Google-Mobile Disallow: / User-Agent: AdsBot-Google Disallow: / User-Agent: Mediapartners-Google Disallow: /