Designing a test for the gap between a permission file and a server

Most write-ups of a crawler-access study lead with the finding. This one is about the design that had to be right before the finding meant anything. The question was narrow: when a website publishes a