Understanding Spark Memory Failures by Breaking a Cluster on Purpose
I recently built an Apache Spark standalone cluster on a single Raspberry Pi 5 (8 GB RAM) using Docker.The cluster had:
1 Spark Master
4 Spark Workers: harvey, mike, donna, louis (named after Suits characters π)
Strict memory limits per container...
bytesofdeepankar.hashnode.dev8 min read