Niels Humbeckbuildingdataproducts.hashnode.dev·10 hours agoMastering Data Pipelines: The Secret to Fast and Reliable Data OperationsIn today’s data-driven world, data pipelines are the backbone of efficient and scalable DataOps. These pipelines are vital for managing both data and code, automating complex workflows, and minimizing manual data handling. But why are they so critica...DiscussBuilding Data Products with DataOps Methodologydataops
Sachin Nandanwarwww.azureguru.net·Dec 6, 2024Service Principal for Microsoft Fabric Data PipelineService Principal is supported in Microsoft Fabric as a more robust and reliable means of authentication. I had blogged about it some time ago where I demonstrated how Service Principal can be leveraged to query Fabric API’s. You can read it here. Al...Discuss·1 like·40 readsmicrosoftfabric
Arpit Tyagidataminds.hashnode.dev·Dec 2, 2024Optimizing "Data Transfer" and "Data Transformation" in ADF: Filtering Even Customer IDs from CSV to SQLStep 1: Inspecting the CSV File in Data Lake: Your First Step to Data Optimization Step 2: Configuring the Data Flow Source: Pointing to the Customer.CSV File Step 3: Filtering Even Customer IDs: Streamlining Data with ADF's Filter Data Flow Step ...Discuss·7 likesAzure Data Factory#DataPipelines
