100 content publishers, ranked by what machines can see.

Newspapers, magazines, broadcasters, reference sites, food, sport, tech and entertainment publishers. These are the sites whose words AI answers are built from, and the ones with the most to decide about training, search and assistant access. Same fifteen fetches, same eighteen tokens, sorted by visibility score. Measured 2026-09-25. Read the findings.

Across the 100

49average score

26block every AI agent

5open to every AI agent

41block training, allow search or assistants

37serve a bot challenge

21refuse anything that is not a full browser

13empty without JavaScript

5publish llms.txt

4have no robots.txt

Who gets blocked most

Agent	Owner	Blocked	Degraded	Full page	Share blocked
Bytespider	ByteDance	87	5	8	87%
CCBot	Common Crawl	86	0	14	86%
ClaudeBot	Anthropic	80	3	17	80%
GPTBot	OpenAI	73	3	23	73%
PerplexityBot	Perplexity	73	3	24	73%
Meta-ExternalAgent	Meta	73	4	22	73%
Amazonbot	Amazon	67	4	28	67%
ChatGPT-User	OpenAI	66	4	29	66%
Perplexity-User	Perplexity	63	4	32	63%
Claude-User	Anthropic	62	7	31	62%
Claude-SearchBot	Anthropic	60	7	33	60%
Google-Extended	Google	56	0	40	56%
OAI-SearchBot	OpenAI	54	5	39	54%
Applebot-Extended	Apple	53	0	43	53%
Bingbot	Microsoft	35	11	51	35%
Googlebot	Google	34	12	51	34%

All 100 sites

#	Site	Score	AI agents
1	foxnews.comlist position 13	100	14 / 14
2	scmp.comlist position 37	95	14 / 14
3	engadget.comlist position 51	95	14 / 14
4	salon.comlist position 74	95	14 / 14
5	thedailybeast.comlist position 75	95	14 / 14
6	substack.comlist position 77	92	13 / 14
7	si.comlist position 94	90	11 / 14
8	cbsnews.comlist position 15	89	12 / 14
9	hindustantimes.comlist position 35	89	12 / 14
10	skysports.comlist position 92	89	12 / 14
11	vice.comlist position 60	87	13 / 14
12	timesofindia.indiatimes.comlist position 34	86	11 / 14
13	latimes.comlist position 18	85	11 / 14
14	tomshardware.comlist position 54	85	11 / 14
15	fortune.comlist position 64	85	11 / 14
16	bleacherreport.comlist position 91	85	11 / 14
17	kotaku.comlist position 97	85	11 / 14
18	globo.comlist position 33	82	10 / 14
19	businessinsider.comlist position 63	82	10 / 14
20	independent.co.uklist position 23	76	8 / 14
21	aljazeera.comlist position 26	73	9 / 14
22	elpais.comlist position 31	69	6 / 14
23	abc.net.aulist position 39	69	6 / 14
24	techcrunch.comlist position 50	67	7 / 14
25	theintercept.comlist position 72	67	7 / 14
26	corriere.itlist position 32	66	5 / 14
27	newsweek.comlist position 68	66	5 / 14
28	webmd.comlist position 81	64	9 / 14
29	espn.comlist position 90	64	5 / 14
30	nypost.comlist position 19	63	4 / 14
31	thetimes.comlist position 22	63	4 / 14
32	forbes.comlist position 62	63	4 / 14
33	wired.comlist position 47	60	3 / 14
34	theverge.comlist position 48	60	3 / 14
35	arstechnica.comlist position 49	60	3 / 14
36	vox.comlist position 57	60	3 / 14
37	bonappetit.comlist position 87	60	3 / 14
38	washingtonpost.comlist position 2	58	1 / 14
39	thesun.co.uklist position 25	58	4 / 14
40	newyorker.comlist position 56	57	2 / 14
41	time.comlist position 67	57	2 / 14
42	healthline.comlist position 80	57	3 / 14
43	mirror.co.uklist position 24	56	2 / 14
44	cbc.calist position 44	55	3 / 14
45	theguardian.comlist position 3	54	2 / 14
46	abcnews.go.comlist position 16	54	4 / 14
47	lemonde.frlist position 29	54	0 / 14
48	polygon.comlist position 96	54	0 / 14
49	epicurious.comlist position 88	53	1 / 14
50	spiegel.delist position 30	51	1 / 14
51	usatoday.comlist position 17	50	0 / 14
52	smh.com.aulist position 40	50	3 / 14
53	theage.com.aulist position 41	50	3 / 14
54	huffpost.comlist position 59	50	0 / 14
55	slate.comlist position 73	50	1 / 14
56	cnet.comlist position 52	48	1 / 14
57	zdnet.comlist position 53	48	1 / 14
58	buzzfeed.comlist position 58	48	0 / 14
59	rollingstone.comlist position 61	48	1 / 14
60	variety.comlist position 99	48	1 / 14
61	hollywoodreporter.comlist position 100	48	1 / 14
62	theglobeandmail.comlist position 45	47	1 / 14
63	ndtv.comlist position 36	46	2 / 14
64	dailymail.co.uklist position 20	45	0 / 14
65	bbc.comlist position 4	44	0 / 14
66	nzherald.co.nzlist position 46	44	0 / 14
67	france24.comlist position 28	43	1 / 14
68	medium.comlist position 76	43	1 / 14
69	ign.comlist position 95	43	1 / 14
70	mayoclinic.orglist position 82	41	2 / 14
71	foodnetwork.comlist position 86	41	2 / 14
72	cnn.comlist position 5	40	0 / 14
73	reuters.comlist position 6	40	0 / 14
74	news.com.aulist position 42	38	1 / 14
75	theaustralian.com.aulist position 43	38	1 / 14
76	theathletic.comlist position 93	38	1 / 14
77	nbcnews.comlist position 14	35	0 / 14
78	cnbc.comlist position 65	35	0 / 14
79	dw.comlist position 27	29	0 / 14
80	npr.orglist position 12	20	0 / 14
81	japantimes.co.jplist position 38	15	1 / 14
82	telegraph.co.uklist position 21	8	1 / 14
83	politico.comlist position 69	5	1 / 14
84	wsj.comlist position 9	3	1 / 14
85	marketwatch.comlist position 66	3	1 / 14
86	axios.comlist position 70	1	2 / 14
87	britannica.comlist position 78	1	2 / 14
88	nih.govlist position 83	1	0 / 14
89	gamespot.comlist position 98	1	0 / 14
90	nytimes.comlist position 1	0	0 / 14
91	apnews.comlist position 7	0	1 / 14
92	bloomberg.comlist position 8	0	0 / 14
93	ft.comlist position 10	0	0 / 14
94	economist.comlist position 11	0	0 / 14
95	theatlantic.comlist position 55	0	0 / 14
96	thehill.comlist position 71	0	0 / 14
97	investopedia.comlist position 79	0	0 / 14
98	verywellhealth.comlist position 84	0	0 / 14
99	allrecipes.comlist position 85	0	0 / 14
100	seriouseats.comlist position 89	0	0 / 14

Source: Curated list of content publishers. The first 100 domains that answered a browser with an HTML page were kept. Fetches for this snapshot were made from a residential connection in Australia rather than from Cloudflare's network, so sites that verify crawler IPs may score differently in a live re-run. Sites counted as refusing non-browser clients answered a plain request carrying a Chrome user agent with an error or a challenge; they score near zero here because nothing short of a real browser gets their pages.