Replace withColumn with withColumns to speed up your Spark applications.

Jan 18, 2024 · 7 min read · Disclaimer - the views and opinions expressed in this blogpost are my own. Practical takeaways The .withColumn() function in Spark has been a popular way of adding and manipulating columns. In my experience, it is far more common than adding columns ...