---
title: "Discussion on \"Spark on YARN architecture\" | Hashnode"
description: "Discussion on \"Spark on YARN architecture\". When we talk about spark on top of Hadoop its generally Hadoop core with Spark compute engine instead of MapReduce, i.e (HDFS, Spark, YARN)\nSpark follows a master-slave architecture where the master is called a Driver in spark and is responsible for ..."
url: "https://hashnode.com/posts/spark-on-yarn-architecture/63bc4b879c005db5ac7e7118"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Spark on YARN architecture](https://blog.yashsrivastava.link/spark-on-yarn-architecture?utm_source=hashnode&utm_medium=feed)

When we talk about spark on top of Hadoop its generally Hadoop core with Spark compute engine instead of MapReduce, i.e (HDFS, Spark, YARN) Spark follows a master-slave architecture where the master is called a Driver in spark and is responsible for ...

Jan 9, 2023 · 2 min read · blog.yashsrivastava.link  
Read the article

-   [#spark](https://hashnode.com/tag/spark)
-   [#yarn](https://hashnode.com/tag/yarn)
-   [#big-data](https://hashnode.com/tag/big-data)
-   [#architecture](https://hashnode.com/tag/architecture)

## Written by

[Yash Srivastava](https://hashnode.com/@Yash722)

@Yash722 · Bengaluru, India

  
[View profile](https://hashnode.com/@Yash722)

Big Data Dev

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
