Repartition vs Coalesce: Spark (Databricks)

As Data Engineer using Spark code, it is important to understand the difference between them and when to use which one. Repartition: Repartition is a method in spark which is used to perform a full shuffle on the data present and creates partitions b...