RSRaghavendra Singhinraghavendrasingh.hashnode.dev·Aug 20, 2020 · 7 min readNear Real-Time Finance Data Warehousing Ussing Apache Spark and Delta LakeFinancial institutions globally deal with massive data volumes that calls for large scale data warehousing and effective processing of real-time transactions. In this blog, we shall discuss the current challenges in these areas and also understand ho...00
RSRaghavendra Singhinraghavendrasingh.hashnode.dev·Aug 3, 2020 · 9 min readContainerization of Pyspark Using KubernetesIntroduction In this blog, we have detailed the approach of how to use Spark on Kubernetes and also a brief comparison between various cluster managers available for Spark. Spark Spark is a general-purpose distributed data processing engine designed ...00
