Gathering useful notebook and environment details at runtime
I was recently working on some tests where I needed to gather some Spark configuration information at runtime to validate that the correct environment was being used (number of executors in my case) and to log some execution details so I could look u...
bradleyschacht.com2 min read