The top 100 websites, ranked by what machines can see.

The 100 most visited websites on the Tranco list, each fetched fifteen ways: as a Chrome browser, as Googlebot and Bingbot, and as twelve AI crawlers and assistants, with robots.txt evaluated for eighteen tokens. Sorted by visibility score. Each page links to a live re-run. Measured 2026-09-25.

Across the 100

76average score

10block every AI agent

20open to every AI agent

23block training, allow search or assistants

25serve a bot challenge

0refuse anything that is not a full browser

6empty without JavaScript

20publish llms.txt

23have no robots.txt

Who gets blocked most

Agent	Owner	Blocked	Degraded	Full page	Share blocked
Bytespider	ByteDance	42	20	35	42%
CCBot	Common Crawl	35	15	49	35%
Meta-ExternalAgent	Meta	33	15	49	33%
ClaudeBot	Anthropic	29	17	52	29%
Amazonbot	Amazon	29	17	53	29%
GPTBot	OpenAI	28	18	53	28%
PerplexityBot	Perplexity	27	19	53	27%
Perplexity-User	Perplexity	27	16	55	27%
OAI-SearchBot	OpenAI	22	18	59	22%
ChatGPT-User	OpenAI	22	18	58	22%
Claude-User	Anthropic	20	17	62	20%
Googlebot	Google	19	19	60	19%
Claude-SearchBot	Anthropic	18	21	60	18%
Bingbot	Microsoft	16	21	62	16%
Google-Extended	Google	14	0	61	14%
Applebot-Extended	Apple	13	0	62	13%

All 100 sites

#	Site	Score	AI agents
1	adobe.comlist position 17	100	2 / 14
2	shopify.comlist position 57	100	14 / 14
3	base.orglist position 59	100	14 / 14
4	stripe.comlist position 80	100	14 / 14
5	alidns.comlist position 85	100	12 / 14
6	hcaptcha.comlist position 89	100	14 / 14
7	github.comlist position 7	97	13 / 14
8	opera.comlist position 25	97	13 / 14
9	apple.comlist position 4	95	14 / 14
10	googledomains.comlist position 15	95	12 / 14
11	qq.comlist position 18	95	14 / 14
12	zoom.uslist position 20	95	14 / 14
13	workers.devlist position 21	95	12 / 14
14	mozilla.orglist position 30	95	14 / 14
15	ui.comlist position 34	95	14 / 14
16	google-analytics.comlist position 35	95	14 / 14
17	bit.lylist position 36	95	14 / 14
18	github.iolist position 38	95	12 / 14
19	apache.orglist position 40	95	14 / 14
20	discord.gglist position 45	95	14 / 14
21	adtrafficquality.googlelist position 50	95	12 / 14
22	discord.comlist position 52	95	14 / 14
23	adobe.iolist position 56	95	14 / 14
24	telekom.netlist position 58	95	12 / 14
25	lencr.orglist position 62	95	12 / 14
26	creativecommons.orglist position 65	95	14 / 14
27	doi.orglist position 71	95	12 / 14
28	pki.googlist position 74	95	14 / 14
29	mit.edulist position 75	95	14 / 14
30	pages.devlist position 77	95	12 / 14
31	nist.govlist position 79	95	14 / 14
32	miui.comlist position 84	95	8 / 14
33	android.comlist position 87	95	14 / 14
34	mzstatic.comlist position 97	95	12 / 14
35	linktr.eelist position 91	94	12 / 14
36	triplinkintl.comlist position 43	92	11 / 14
37	who.intlist position 90	92	11 / 14
38	example.comlist position 55	90	12 / 14
39	microsoft.comlist position 2	87	13 / 14
40	windows.comlist position 26	87	11 / 14
41	soundcloud.comlist position 63	87	13 / 14
42	vungle.comlist position 69	87	13 / 14
43	cpanel.netlist position 81	87	13 / 14
44	hp.comlist position 99	87	13 / 14
45	f5.comlist position 24	86	13 / 14
46	nginx.comlist position 28	86	11 / 14
47	skype.comlist position 13	85	12 / 14
48	paypal.comlist position 53	85	3 / 14
49	forter.comlist position 92	85	11 / 14
50	gravatar.comlist position 49	84	9 / 14
51	applovin.comlist position 51	83	11 / 14
52	linkedin.comlist position 6	80	0 / 14
53	vimeo.comlist position 23	80	11 / 14
54	afternic.comlist position 47	80	9 / 14
55	gmail.comlist position 76	80	2 / 14
56	blogspot.comlist position 32	79	12 / 14
57	google.comlist position 1	75	2 / 14
58	bing.comlist position 8	75	4 / 14
59	kaspersky.comlist position 44	75	4 / 14
60	canva.comlist position 83	75	4 / 14
61	hosting24.comlist position 60	74	7 / 14
62	t-online.delist position 70	72	7 / 14
63	cloud.microsoftlist position 9	70	1 / 14
64	samsung.comlist position 27	70	7 / 14
65	flickr.comlist position 61	69	6 / 14
66	youtube.comlist position 3	65	2 / 14
67	youtu.belist position 11	65	2 / 14
68	digicert.comlist position 12	65	2 / 14
69	yuga.comlist position 31	65	2 / 14
70	dns.googlelist position 46	65	0 / 14
71	duckdns.orglist position 64	65	0 / 14
72	dnsmadeeasy.comlist position 95	65	0 / 14
73	netflix.comlist position 10	64	2 / 14
74	springer.comlist position 96	64	6 / 14
75	theguardian.comlist position 68	63	4 / 14
76	forbes.comlist position 73	63	4 / 14
77	amazonvideo.comlist position 37	57	2 / 14
78	bbc.co.uklist position 78	56	2 / 14
79	snapchat.comlist position 39	54	0 / 14
80	bbc.comlist position 72	53	2 / 14
81	nature.comlist position 100	52	2 / 14
82	openai.comlist position 22	51	2 / 14
83	b-cdn.netlist position 33	48	2 / 14
84	wordpress.comlist position 29	46	2 / 14
85	unity3d.comlist position 41	46	2 / 14
86	webex.comlist position 54	46	2 / 14
87	cisco.comlist position 88	46	2 / 14
88	salesforce.comlist position 98	46	2 / 14
89	intuit.comlist position 42	45	3 / 14
90	t.colist position 82	45	0 / 14
91	yahoo.comlist position 16	43	1 / 14
92	medium.comlist position 66	43	1 / 14
93	chatgpt.comlist position 19	42	1 / 14
94	xiaomi.comlist position 48	41	2 / 14
95	ibm.comlist position 93	41	2 / 14
96	cnn.comlist position 67	40	0 / 14
97	reuters.comlist position 94	40	0 / 14
98	meraki.comlist position 86	38	1 / 14
99	twitter.comlist position 5	35	0 / 14
100	x.comlist position 14	35	0 / 14

Source: Tranco top sites list. The first 100 domains that answered a browser with an HTML page were kept. Fetches for this snapshot were made from a residential connection in Australia rather than from Cloudflare's network, so sites that verify crawler IPs may score differently in a live re-run. Sites counted as refusing non-browser clients answered a plain request carrying a Chrome user agent with an error or a challenge; they score near zero here because nothing short of a real browser gets their pages.