Setup local Spark Cluster on Mac and explore UI for Master, Workers, and Jobs(Python using Jupyter notebook)

What is covered In this blog, I would describe my experiments about setting up a local (standalone) Spark cluster on Mac M1 machine. Would start jupyter notebook using anaconda navigator Submit jobs using Python code executing in the notebook with ...