---
title: "Discussion on \"I Got Tired of Guessing Spark Configs. So I Built SparkLens.\" | Hashnode"
description: "Discussion on \"I Got Tired of Guessing Spark Configs. So I Built SparkLens.\". Every data engineer has been here.\nYou tune your spark-submit. You set the memory, the cores, the executors. It looks right. You hit submit.\nThree hours later — ExecutorLostFailure.\nYou open the Spark"
url: "https://hashnode.com/posts/i-got-tired-of-guessing-spark-configs-so-i-built-sparklens/69cb708e4b49f4a8e9fca18e"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [I Got Tired of Guessing Spark Configs. So I Built SparkLens.](https://bytesofdeepankar.hashnode.dev/i-got-tired-of-guessing-spark-configs-so-i-built-sparklens?utm_source=hashnode&utm_medium=feed)

Every data engineer has been here. You tune your spark-submit. You set the memory, the cores, the executors. It looks right. You hit submit. Three hours later — ExecutorLostFailure. You open the Spark

Mar 31 · 3 min read · bytesofdeepankar.hashnode.dev  
Read the article

## Written by

[Deepankar Yadav](https://hashnode.com/@BytesOfDeepankar)

@BytesOfDeepankar · India

  
[View profile](https://hashnode.com/@BytesOfDeepankar)

Making data sexy, one query at a time: Data's ultimate wingman.

I wrangle bytes at EY, making healthcare data sing. By night, I spill the beans (and code) on #dataengineering on Hashnode. Join me to conquer coding & laugh along the way! 🚀

## Responses

Markdown supported · ⌘↵ to post

No responses yet.