Optimizing Pytest and Pyspark/Spark

Our current tests (302) are running on average of of ~55 minutes. This is a combination of unit and end-to-end tests. My dev machine is a Dell Precision 5550 with a Core i9-10885H running at 2.4Ghz. Has 64GB of memory and a fairly fast SSD. We ar...