---
title: "Discussion on \"Mysterious Spark Checkpoints Behaviour\" | Hashnode"
description: "Discussion on \"Mysterious Spark Checkpoints Behaviour\". It all started from a change in the checkpoint path of our Spark applications. We use Spark Structured streaming and AWS S3 buckets to maintain checkpoints. Let’s say we were using s3://bucket/spark/t"
url: "https://hashnode.com/posts/mysterious-spark-checkpoints-behaviour/659e90ea5946a6311eb37de4"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Mysterious Spark Checkpoints Behaviour](https://blog.datachef.co/mysterious-spark-checkpoints-behaviour?utm_source=hashnode&utm_medium=feed)

It all started from a change in the checkpoint path of our Spark applications. We use Spark Structured streaming and AWS S3 buckets to maintain checkpoints. Let’s say we were using s3://bucket/spark/t

Dec 20, 2023 · 3 min read · blog.datachef.co  
Updated Feb 25  
Read the article

-   [#structured-streaming](https://hashnode.com/tag/structured-streaming)
-   [#spark](https://hashnode.com/tag/spark)

## Written by

[Shahin](https://hashnode.com/@Shahinism)

@Shahinism · Haarlem, Netherlands

  
[View profile](https://hashnode.com/@Shahinism)

Sometimes you gotta run before you can walk

🧑‍🍳 Cooking data as a chef de partie at DataChef.co by day! 🪄 Avid coder inventing magic by night!

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
