Discussion

Abstract Algorithms

Exploring the fascinating world of algorithms, data structures, and software engineering through clear explanations and practical examples.

Apr 19

Spark Executor Sizing: Memory Model, Core Tuning, and GC Strategy

TLDR: Spark executor OOMs are almost never caused by insufficient total cluster RAM — they are caused by misallocating memory across five distinct JVM regions while ignoring GC behavior and memoryOver

abstractalgorithms.dev37 min read

#apache-spark #performance-tuning #jvm #gc #memory-management #big-data

Responses

No responses yet.

Search Hashnode

Spark Executor Sizing: Memory Model, Core Tuning, and GC Strategy

Responses

Recent in Forum