Spark memory

a) Summarize Spark Memory Allocation The executor has JVM Heap Space Memory set by parameter spark.executor.memory. This include Reserved memory, User memory, Spark memory for storage and execution and Python worker memory. Non-JVM Memory is Memory O...