Sachin Nandanwarwww.azureguru.net·Oct 15, 2024Managed Identities in Microsoft AzureImagine managing a large-scale data environment where you have tens of different database servers spread across multiple regions or environments, including production, development, and staging. Each of these database servers requires its own set of c...70 readsAzure
Bob Blackburnbobblackburn.com·Aug 19, 2024Azure Data Factory CI/CD with GitHub and Azure PipelinesWithout source control for Azure Data Factory (ADF), you only have the option to publish your pipeline. And, it has to validate. Now with source control, we can save intermediate work, use branches, and publish when we are ready. The next step is CI/...Azure
Josef Richbergjosefrichberg.com·Jul 19, 2024How to Skip Rows in Azure Data Factory Pipeline's Excel SourceI was building a data factory source the other day and I needed to skip the first 5 rows. This is intuitive and easy within a text (csv) source as there is a setting to skip the first N rows. In excel there is a 'Range' option which has as an example...87 readsdata factory
Bob Blackburnbobblackburn.com·Apr 29, 20243 Steps to Run PowerShell in Azure Data FactoryAzure Data Factory has many capabilities. But no tool is the best at everything. Sometimes you have an existing script that needs to be automated or PowerShell is the best programming option for the task at hand. Currently, ADF does not have a PowerS...Azure
Abhinandan Shresthaabhinandanshrestha.hashnode.dev·Oct 3, 2023What is Azure Key Vault and how to use it in your Azure Pipeline?To understand Azure Key vaults, think of a scenario like a backend connection to databases. The question is “Do we directly use connection strings in our code?”. Storing connection strings and other sensitive information directly in your code is gene...30 readsAzure Key Vault
Sandeep Pawarfabric.guru·Aug 7, 2023Boosting Copy Activity Throughput in FabricIn all of my Fabric related blog posts, I make it abundantly clear that Fabric is (as of the writing of the post), in public preview and the performance/features may change at any time. I want to discuss one such significant performance improvement i...1 like·1.5K readsmicrosoftfabric