#dataengineering

Replace withColumn with withColumns to speed up your Spark applications.

Disclaimer - the views and opinions expressed in this blogpost are my own. Practical takeaways The .withColumn() function in Spark has been a popular way of adding and manipulating columns. In my experience, it is far more common than adding columns ...