BKBalmukund kumarinfrom-pipelines-to-governance.hashnode.dev·Sep 22, 2025 · 4 min readOverview of Data Flow Features in Azure Data FactoryData Flow is essentially a Spark V2 version of clusters that helps us perform data transformation operations in cloud services like Azure. Before Data Flow, if you wanted to perform transformations, you could simply use joins and other operations on ...00
BKBalmukund kumarinfrom-pipelines-to-governance.hashnode.dev·Sep 16, 2025 · 4 min readUnlocking the Power of Azure Data Factory: Streamlining Data Engineering in the CloudAzure is a cloud-based platform that offers many services like IaaS (Infrastructure as a Service), PaaS (Platform as a Service), and SaaS (Software as a Service). ADF ( Azure Data Factory ) is a Paas i.e, Platform as a service which leverages our clo...00
BKBalmukund kumarinfrom-pipelines-to-governance.hashnode.dev·Sep 14, 2025 · 12 min readMastering Data Engineering: From Pipelines to GovernanceAirflow UI provides a comprehensive view of pipeline execution, including task status, logs, alerts, and information on failed or interrupted pipelines. Automating Data Pipelines :- Four core data orcherstration we have been discussed earlier like Wo...00