---
title: "Shahida R. Khan (@shahida-r-khan) | Hashnode"
description: "Staff Data Engineer | PySpark, Databricks, Delta Lake, AWS. Read the latest articles by Shahida R. Khan on Hashnode."
url: "https://hashnode.com/@shahida-r-khan"
---

@shahida-r-khan

# Shahida R. Khan

@shahida-r-khan · Mumbai, India · Joined March 2026

Staff Data Engineer | PySpark, Databricks, Delta Lake, AWS

### [Spark: From Code to Chaos (to Organized Chaos) - A Data Odyssey](https://modern-data.hashnode.dev/spark-from-code-to-chaos-to-organized-chaos-a-data-odyssey?utm_source=hashnode&utm_medium=feed)

Imagine this: You have a colossal mountain of data. It's so massive, it's basically its own mountain range. And you need to find one tiny, specific diamond hidden somewhere in there. You try to use yo

9 min read · [modern-data.hashnode.dev](https://modern-data.hashnode.dev/spark-from-code-to-chaos-to-organized-chaos-a-data-odyssey?utm_source=hashnode&utm_medium=feed)

[Mar 16](https://hashnode.com/posts/spark-from-code-to-chaos-to-organized-chaos-a-data-odyssey/69b78e7b68c6d51b0127c775)

### [PySpark + Databricks + Delta Lake: 7 Battle-Tested Patterns to Stop Wasting Hours (And Dollars) – Junior-Friendly Guide](https://modern-data.hashnode.dev/pyspark-databricks-delta-lake-7-battle-tested-patterns-to-stop-wasting-hours-and-dollars-junior-friendly-guide?utm_source=hashnode&utm_medium=feed)

Start with a relatable junior struggle: "Ever stared at a Spark UI wondering why your 'simple' PySpark job is shuffling 100GB for a 1GB dataset? Or why Delta reads take forever? I did – for years. As

4 min read · [modern-data.hashnode.dev](https://modern-data.hashnode.dev/pyspark-databricks-delta-lake-7-battle-tested-patterns-to-stop-wasting-hours-and-dollars-junior-friendly-guide?utm_source=hashnode&utm_medium=feed)

[Mar 12](https://hashnode.com/posts/pyspark-databricks-delta-lake-7-battle-tested-patterns-to-stop-wasting-hours-and-dollars-junior-friendly-guide/69b3045c93256dfc53fe6944)