Updating to Pyspark 3.3.1 and Python 3.10
Recently revisited updating the M1 Macbook Air to use the latest version of Pyspark and Python 3.10. Ran into some issues with Delta Table references and tests which were resolved when updating the delta-spark package to the latest version.
pip insta...
wind010.hashnode.dev2 min read