What Actually Happens When You Call spark.read? One Line of Python, a Thousand Tasks

TL;DR: spark.read.parquet(path) reads almost nothing. The real work starts at the first action, when Spark turns your DataFrame into four plans, slices your files into tasks, ships those tasks to exec