Two Webs

Top 100 / adtrafficquality.google

95

Mostly one web

12 of 14 AI agents get the full page at https://adtrafficquality.google/. Checked 2026-09-25 09:18 UTC.

adtrafficquality.google scores 95 out of 100 for machine visibility, number 21 of the 100 most visited websites checked on 2026-09-25. 12 of 14 AI agents receive the full page: 6 of 8 training crawlers, 3 of 3 AI search indexes and 3 of 3 assistant fetchers. There is no llms.txt.

youfull pagedegradedblockedunknown

Human

Status
200 → https://www.google.com/ads/adtrafficquality/
Title
Google Ad Traffic Quality
H1
We protect you from invalid activity and advertising fraud
Words
527
Scripts
9 tags · 2 KB
Meta robots
none
Canonical
none
Server
sffe

Machine

robots.txt
none (HTTP 404)
llms.txt
missing
llms-full.txt
missing
X-Robots-Tag
none
Blocked
none
Degraded
none
Challenged
none

Gaps

  • low
    No robots.txtEvery crawler is allowed by default. Add one if you want any say in the matter.
  • low
    No llms.txtOptional, but a short curated index at /llms.txt is the cheapest way to tell assistants what matters on this site.

Every agent

AgentTyperobots.txtFetchWordsResult
Human (Chrome)YouHumanno file2002642 ms527visible
HTTP 200, 527 words
GooglebotGoogle · Classic search index. Also feeds AI Overviews.Search engineno file2002642 ms527visible
HTTP 200, 527 words
Google-ExtendedGoogle · Robots-only token controlling Gemini training use. Never fetches on its own.AI trainingno filen/aunknown
Robots-only token; allowed by robots.txt
GPTBotOpenAI · Training crawler for OpenAI models.AI trainingno file2002642 ms527visible
HTTP 200, 527 words
OAI-SearchBotOpenAI · Indexes for ChatGPT search results and citations.AI search indexno file2002795 ms527visible
HTTP 200, 527 words
ChatGPT-UserOpenAI · Live fetch when a user asks ChatGPT about a page.AI assistant (live fetch)no file2002792 ms527visible
HTTP 200, 527 words
ClaudeBotAnthropic · Training crawler for Claude models.AI trainingno file2002639 ms527visible
HTTP 200, 527 words
Claude-SearchBotAnthropic · Indexes for Claude web search.AI search indexno file2002638 ms527visible
HTTP 200, 527 words
Claude-UserAnthropic · Live fetch when a user asks Claude about a page.AI assistant (live fetch)no file2002795 ms527visible
HTTP 200, 527 words
PerplexityBotPerplexityAI search indexno file2002793 ms527visible
HTTP 200, 527 words
Perplexity-UserPerplexityAI assistant (live fetch)no file2002636 ms527visible
HTTP 200, 527 words
BingbotMicrosoft · Bing index. Also feeds Copilot and ChatGPT search.Search engineno file2002631 ms527visible
HTTP 200, 527 words
Applebot-ExtendedApple · Robots-only token for Apple Intelligence training.AI trainingno filen/aunknown
Robots-only token; allowed by robots.txt
Meta-ExternalAgentMetaAI trainingno file2002638 ms527visible
HTTP 200, 527 words
AmazonbotAmazon · Alexa and Amazon AI.AI trainingno file2002638 ms527visible
HTTP 200, 527 words
BytespiderByteDance · Known for ignoring robots.txt.AI trainingno file2002634 ms527visible
HTTP 200, 527 words
CCBotCommon Crawl · Open dataset used to train most LLMs.AI trainingno file2002642 ms527visible
HTTP 200, 527 words

Snapshot

Measured 2026-09-25 09:18 UTC from a residential connection. Sites change their rules often, and sites that verify crawler IPs answer differently to different networks. Run a live comparison to see what adtrafficquality.google does right now, from Cloudflare's network.

← discord.gg (95)All 100 top 100discord.com (95) →