Overview of Data Flow Features in Azure Data FactoryData Flow is essentially a Spark V2 version of clusters that helps us perform data transformation operations in cloud services like Azure. Before Data Flow, if you wanted to perform transformations, you could simply use joins and other operations on ...4 min read·from-pipelines-to-governance.hashnode.devSep 22, 2025
Unlocking the Power of Azure Data Factory: Streamlining Data Engineering in the CloudAzure is a cloud-based platform that offers many services like IaaS (Infrastructure as a Service), PaaS (Platform as a Service), and SaaS (Software as a Service). ADF ( Azure Data Factory ) is a Paas i.e, Platform as a service which leverages our clo...4 min read·from-pipelines-to-governance.hashnode.devSep 16, 2025
Mastering Data Engineering: From Pipelines to GovernanceDiscover how to build ETL pipelines with Spark and Airflow. A step-by-step guide for data engineers to create reliable and automated workflows.12 min read·from-pipelines-to-governance.hashnode.devSep 14, 2025