---
title: "Yash Srivastava (@Yash722) | Hashnode"
description: "Big Data Dev. Read the latest articles by Yash Srivastava on Hashnode."
url: "https://hashnode.com/@Yash722"
---

@Yash722

# Yash Srivastava

@Yash722 · Bengaluru, India · Joined December 2022

Big Data Dev

### [Spark Stages, Tasks, and Jobs](https://blog.yashsrivastava.link/spark-stages-tasks-and-jobs?utm_source=hashnode&utm_medium=feed)

There are mainly 3 components in spark UI Jobs A spark application can have multiple jobs based on the number of actions (#jobs =#actions) in the application. These jobs can have a common rdd somewhere in the execution map or they can be separate al...

2 min read · [blog.yashsrivastava.link](https://blog.yashsrivastava.link/spark-stages-tasks-and-jobs?utm_source=hashnode&utm_medium=feed)

[Jan 24, 2023](https://hashnode.com/posts/spark-stages-tasks-and-jobs/63d0156225f44283631cc19e)

### [Basic Spark RDD transformations](https://blog.yashsrivastava.link/basic-spark-rdd-transformations?utm_source=hashnode&utm_medium=feed)

spark rdd transformations

4 min read · [blog.yashsrivastava.link](https://blog.yashsrivastava.link/basic-spark-rdd-transformations?utm_source=hashnode&utm_medium=feed)

[Jan 18, 2023](https://hashnode.com/posts/basic-spark-rdd-transformations/63c798391f95cf39358d0e2a)

### [Spark on YARN architecture](https://blog.yashsrivastava.link/spark-on-yarn-architecture?utm_source=hashnode&utm_medium=feed)

When we talk about spark on top of Hadoop its generally Hadoop core with Spark compute engine instead of MapReduce, i.e (HDFS, Spark, YARN) Spark follows a master-slave architecture where the master is called a Driver in spark and is responsible for ...

2 min read · [blog.yashsrivastava.link](https://blog.yashsrivastava.link/spark-on-yarn-architecture?utm_source=hashnode&utm_medium=feed)

[Jan 9, 2023](https://hashnode.com/posts/spark-on-yarn-architecture/63bc4b879c005db5ac7e7118)

### [Shared variables in spark](https://blog.yashsrivastava.link/shared-variables-in-spark?utm_source=hashnode&utm_medium=feed)

Sometimes in a spark application, we need to share small data across all the machines for processing. For example, if you want to filter some set of words from a large dataset residing in a datalake. Or if we simply just want to know how many blank l...

2 min read · [blog.yashsrivastava.link](https://blog.yashsrivastava.link/shared-variables-in-spark?utm_source=hashnode&utm_medium=feed)

[Jan 9, 2023](https://hashnode.com/posts/shared-variables-in-spark/63bc4239227cece80931c1bb)

### [What is Apache Spark?](https://blog.yashsrivastava.link/what-is-apache-spark?utm_source=hashnode&utm_medium=feed)

In simple terms, Apache spark is an in-memory unified parallel compute engine. In Memory,Most of the operations in apache spark happen in memory and there is very less disk IO operation giving rise to faster data transformation and computation, unlik...

2 min read · [blog.yashsrivastava.link](https://blog.yashsrivastava.link/what-is-apache-spark?utm_source=hashnode&utm_medium=feed)

[Jan 4, 2023](https://hashnode.com/posts/what-is-apache-spark/63b545f2d290c9ae41140edb)
