Setup local Spark Cluster on Mac and explore UI for Master, Workers, and Jobs(pyspark)
What is covered
In this blog, I would describe my experiments about setting up a local (standalone) Spark cluster on Mac M1 machine.
Would start pyspark with an option to use the master setup in above step.
Explore the UI for:
Master
Worker
Jobs (t...
sriram.uscconsulting.net3 min read