Crawl-to-refer ratios in July 2026: Anthropic 1,917:1, OpenAI 251:1
Crawl-to-refer ratios in July 2026: Anthropic 1,917:1, OpenAI 251:1
Summary. In July 2025, Cloudflare published a ratio that went round the world: Anthropic's crawlers made roughly 70,900 HTML page re
ecorpit.hashnode.dev16 min read