---
title: "Discussion on \"What Actually Happens When You Call spark.read? One Line of Python, a Thousand Tasks\" | Hashnode"
description: "Discussion on \"What Actually Happens When You Call spark.read? One Line of Python, a Thousand Tasks\". TL;DR: spark.read.parquet(path) reads almost nothing. The real work starts at the first action, when Spark\nturns your DataFrame into four plans, slices your files into tasks, ships those tasks to exec"
url: "https://hashnode.com/posts/what-actually-happens-when-you-call-spark-read-one-line-of-python-a-thousand-tasks/6abe803aa22831cb47e3a3d7"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [What Actually Happens When You Call spark.read? One Line of Python, a Thousand Tasks](https://ani-db.hashnode.dev/what-actually-happens-when-you-call-spark-read-one-line-of-python-a-thousand-tasks?utm_source=hashnode&utm_medium=feed)

TL;DR: spark.read.parquet(path) reads almost nothing. The real work starts at the first action, when Spark turns your DataFrame into four plans, slices your files into tasks, ships those tasks to exec

Oct 1 · 58 min read · ani-db.hashnode.dev  
Read the article

## Written by

[Aniketh Deshpande](https://hashnode.com/@ASDeshpande)

@ASDeshpande · Bangalore, India

  
[View profile](https://hashnode.com/@ASDeshpande)

Data Engineer

## Responses

Markdown supported · ⌘↵ to post

No responses yet.