Designing Retry Strategies for Large-Scale Web Data Collection
At small scale, retry logic looks simple.
A request fails. Wait a moment. Try again.
At large scale, that approach can become one of the fastest ways to make a web data collection system less reliable
