ShahinforDataChef's Blogblog.datachef.co·Dec 20, 2023Mysterious Spark Checkpoints BehaviourIt all started from a change in the checkpoint path of our Spark applications. We use Spark Structured streaming and AWS S3 buckets to maintain checkpoints. Let’s say we were using s3://bucket/spark/topic/ as the checkpoint path, and we changed it to...493 readsStructured StreamingAdd a thoughtful commentNo comments yetBe the first to start the conversation.