ERErik Rekolainturva.dev·20h ago · 2 min readSitemaps, robots.txt and agent accessrobots.txt and the sitemap are the oldest machine-readable files on the web, and they still decide whether an agent is allowed in and what it can find. An agent reads robots.txt to learn the rules and00
ERErik Rekolainturva.dev·1d ago · 4 min readFour AI agents re-checked the guidesThe guides on turva.dev describe other people's specifications, and specifications move. A sentence that says "the specification says" is true the day it ships and starts aging the day after, and no s00
ERErik Rekolainturva.dev·1d ago · 2 min readPrerendering and why agents see empty pagesMany sites render their content with JavaScript in the browser, which means the first response an agent receives is an almost empty shell. A person waits a moment and the page fills in. An agent that 00
ERErik Rekolainturva.dev·2d ago · 2 min readHow agents authenticateAgent authentication is how an automated client proves who it is and gains scoped access to a site, without a human logging in first. It is the step that turns a read-only agent into one that can act 00
ERErik Rekolainturva.dev·3d ago · 2 min readx402 and agent paymentsx402 is a way for a site to ask an agent to pay before it returns a resource, using the long-reserved HTTP 402 Payment Required status. It lets an automated client discover a price, pay, and continue,10