Replace withColumn with withColumns to speed up your Spark applications.
Disclaimer - the views and opinions expressed in this blogpost are my own.
Practical takeaways
The .withColumn() function in Spark has been a popular way of adding and manipulating columns. In my experience, it is far more common than adding columns ...
aneesshaikh.hashnode.dev7 min read