Two Webs

Top 100 / opera.com

97

Mostly one web

13 of 14 AI agents get the full page at https://opera.com/. Checked 2026-09-25 09:17 UTC.

opera.com scores 97 out of 100 for machine visibility, number 8 of the 100 most visited websites checked on 2026-09-25. 13 of 14 AI agents receive the full page: 7 of 8 training crawlers, 3 of 3 AI search indexes and 3 of 3 assistant fetchers. The site publishes an llms.txt.

youfull pagedegradedblockedunknown

Human

Status
200 → https://www.opera.com/
Title
Opera Web Browser | Faster, Safer, Smarter | Opera
H1
Your personal browser
Words
557
Scripts
10 tags · 4 KB
Meta robots
none
Canonical
https://www.opera.com/
Server
hidden

Machine

robots.txt
1 groups · 1 sitemaps
llms.txt
present
llms-full.txt
missing
X-Robots-Tag
none
Blocked
none
Degraded
Bytespider
Challenged
none

Gaps

  • medium
    1 agents get a degraded pageBytespider: Different content than humans receive
  • info
    Canonical points elsewhereCanonical is https://www.opera.com/. Indexes will credit that URL, not this one.

Every agent

AgentTyperobots.txtFetchWordsResult
Human (Chrome)YouHumanallowed2003039 ms557visible
HTTP 200, 557 words
GooglebotGoogle · Classic search index. Also feeds AI Overviews.Search engineallowed2003039 ms557visible
HTTP 200, 557 words
Google-ExtendedGoogle · Robots-only token controlling Gemini training use. Never fetches on its own.AI trainingallowedn/avisible
Robots-only token; allowed by robots.txt
GPTBotOpenAI · Training crawler for OpenAI models.AI trainingallowed2003023 ms557visible
HTTP 200, 557 words
OAI-SearchBotOpenAI · Indexes for ChatGPT search results and citations.AI search indexallowed2003039 ms557visible
HTTP 200, 557 words
ChatGPT-UserOpenAI · Live fetch when a user asks ChatGPT about a page.AI assistant (live fetch)allowed2003099 ms557visible
HTTP 200, 557 words
ClaudeBotAnthropic · Training crawler for Claude models.AI trainingallowed2003022 ms557visible
HTTP 200, 557 words
Claude-SearchBotAnthropic · Indexes for Claude web search.AI search indexallowed2003104 ms557visible
HTTP 200, 557 words
Claude-UserAnthropic · Live fetch when a user asks Claude about a page.AI assistant (live fetch)allowed2003099 ms557visible
HTTP 200, 557 words
PerplexityBotPerplexityAI search indexallowed2003073 ms557visible
HTTP 200, 557 words
Perplexity-UserPerplexityAI assistant (live fetch)allowed2003102 ms557visible
HTTP 200, 557 words
BingbotMicrosoft · Bing index. Also feeds Copilot and ChatGPT search.Search engineallowed2003098 ms557visible
HTTP 200, 557 words
Applebot-ExtendedApple · Robots-only token for Apple Intelligence training.AI trainingallowedn/avisible
Robots-only token; allowed by robots.txt
Meta-ExternalAgentMetaAI trainingallowed2003072 ms557visible
HTTP 200, 557 words
AmazonbotAmazon · Alexa and Amazon AI.AI trainingallowed2003021 ms557visible
HTTP 200, 557 words
BytespiderByteDance · Known for ignoring robots.txt.AI trainingallowed2003036 ms596partial
Different content than humans receive
CCBotCommon Crawl · Open dataset used to train most LLMs.AI trainingallowed2003041 ms557visible
HTTP 200, 557 words

Snapshot

Measured 2026-09-25 09:17 UTC from a residential connection. Sites change their rules often, and sites that verify crawler IPs answer differently to different networks. Run a live comparison to see what opera.com does right now, from Cloudflare's network.

← github.com (97)All 100 top 100apple.com (95) →