The Distributed Compute Playground: Everything You Can Plug In and Tune in an Apache Spark Job
TL;DR: An Apache Spark job is not one thing. It is a stack of nine layers, and almost every layer has parts you can swap: where executors come from, how the code is written, which engine runs the plan
ani-db.hashnode.dev65 min read