Good example. One data point on the web crawl column: when we ran our agent-readiness check on 20 big US retailers on November 5, Home Depot's homepage sent our checker a bot-protection response instead of the page, on both runs. So today an agent that is not on their allowlist may not get the crawl at all. A server like this would be a door the retailer controls, which makes the case for it stronger.