crawler	sites_naming_it	sites_blocking_it_fully	share_of_robots_read
CCBot	1503	1177	16.2%
Bytespider	1369	1153	15.9%
GPTBot	1675	1141	15.7%
ClaudeBot	1497	1047	14.4%
meta-externalagent	1238	959	13.2%
Applebot-Extended	1202	923	12.7%
Google-Extended	1365	919	12.6%
Amazonbot	1178	876	12.0%
anthropic-ai	1015	858	11.8%
Diffbot	1006	853	11.7%
cohere-ai	915	810	11.1%
PerplexityBot	946	541	7.4%
FacebookBot	721	519	7.1%
ChatGPT-User	893	470	6.5%
Claude-User	546	309	4.2%
Perplexity-User	524	307	4.2%
OAI-SearchBot	728	304	4.2%
DuckAssistBot	434	298	4.1%
Claude-SearchBot	537	295	4.1%
MistralAI-User	362	280	3.8%
bingbot	541	18	0.2%
Googlebot	622	7	0.1%
