---
title: "Discussion on \"Slowly Changing Dimensions with PySpark and Delta Lake\" | Hashnode"
description: "Discussion on \"Slowly Changing Dimensions with PySpark and Delta Lake\". Slowly Changing Dimensions (SCDs) are a vital concept in data warehousing, particularly in managing data that changes over time. As the entities evolve over time, it’s crucial to track and manage these changes effectively. This is where Slowly Changi..."
url: "https://hashnode.com/posts/slowly-changing-dimensions-with-pyspark-and-delta-lake/665855d5658e97e981127529"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Slowly Changing Dimensions with PySpark and Delta Lake](https://harshita.hashnode.dev/slowly-changing-dimensions-with-pyspark-and-delta-lake?utm_source=hashnode&utm_medium=feed)

Slowly Changing Dimensions (SCDs) are a vital concept in data warehousing, particularly in managing data that changes over time. As the entities evolve over time, it’s crucial to track and manage these changes effectively. This is where Slowly Changi...

May 30, 2024 · 2 min read · harshita.hashnode.dev  
Read the article

-   [#data-engineering](https://hashnode.com/tag/data-engineering)
-   [#spark](https://hashnode.com/tag/spark)
-   [#delta-table](https://hashnode.com/tag/delta-table)
-   [#deltalake](https://hashnode.com/tag/deltalake)
-   [#pyspark](https://hashnode.com/tag/pyspark)

## Written by

[Harshita Chaudhary](https://hashnode.com/@harshita0812)

@harshita0812 · India

  
[View profile](https://hashnode.com/@harshita0812)

Software Engineer - Data

Hii, My name is Harshita Chaudhary, I am a data engineer. I have joined Hashnode to share my day to day learnings with you guys, I like to write tech blogs on the fundamental topics of data engineering in a concise manner adding proper and practical examples. Happy learning and Keep Querying !!

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
