---
title: "Vaishnave Subbramanian (@justnave) | Hashnode"
description: "Software Engineer by day, Musician by night. Read the latest articles by Vaishnave Subbramanian on Hashnode."
url: "https://hashnode.com/@justnave"
---

@justnave

# Vaishnave Subbramanian

@justnave · Joined April 2023

Software Engineer by day, Musician by night

## Comments

[Hey, you're right. Thanks for letting me know that I need to bring more clarity to that part. So, memory or RAM (Deserialised) <--> Disk Spill (Serialised into temporary spill files) I've updated the article on this, so check it out: https://vaishnave.page/sparks-fly#heading-serialization-between-memory-and-disk](https://hashnode.com/posts/sparks-fly/660ee730f3e8f690989ae4b1/comment/6610ec521644e47ea7a489be#reply-66129e6b8181a7284cf2e4eb)

Reply · Article · Apr 7, 2024 · [Sparks Fly](https://hashnode.com/posts/sparks-fly/660ee730f3e8f690989ae4b1)

[Hi Kolisetty Sasiram The shuffling does happen in the case of sort-merge join as well. I didn't include it because only if the data is not already partitioned by the join key, Spark performs a shuffle operation to redistribute the data across the cluster based on the join key. But, since I'm listing out the process, it makes more sense to add it. Thank you for your input!](https://hashnode.com/posts/spark-illuminated/66046ddd2f86edc7acae90f9/comment/6610f3a04af55564656eec9a#reply-66129a2da90a0f30c35f46ad)

Reply · Article · Apr 7, 2024 · [Spark Illuminated](https://hashnode.com/posts/spark-illuminated/66046ddd2f86edc7acae90f9)
