Giving Streaming Systems Memory: Checkpointing and Progress Recovery

Yesterday, we learned how to make a system hit the brakes when it’s overloaded. But there’s an even more important question: How does the courier know how far they’ve gotten? Today, let’s talk about checkpoint. The Courier’s Memory Problem: Which Pac...