Spark Executor Sizing: Memory Model, Core Tuning, and GC Strategy
TLDR: Spark executor OOMs are almost never caused by insufficient total cluster RAM — they are caused by misallocating memory across five distinct JVM regions while ignoring GC behavior and memoryOverhead. Master the UnifiedMemoryManager model, apply...
abstractalgorithms.dev33 min read