Feb 24, 2025 · 2 min read · Create a Master Key if not present. Why? If a database scoped credential is used, Synapse requires encryption. The Master Key ensures that credentials are securely stored. ✅ Needed only once per database. ✅ Required for setting up authe...
Join discussionJan 30, 2025 · 8 min read · Let's say you have one or more CSV files and you want to convert them to Parquet format and also upload them to a Lakehouse table. The available options for this in the Fabric environment are either through a notebook or a data pipeline but there are...
Join discussion
Jan 28, 2025 · 10 min read · As many of you may know, Microsoft Fabric offers a GraphQL API to access data from Warehouse, Fabric Lakehouse through SQL Analytics and Fabric SQL databases. However it lacks a built-in feature to expose data as a REST API. Imagine you have an exist...
Join discussion
Jan 21, 2025 · 11 min read · This article is inspired by Sandeep Pawar’s earlier article. Sandeep in that article demonstrated an innovative approach to obtain essential delta lake metadata details across single/multiple lakehouses. This gathered data can play crucial role for a...
Join discussion
Jan 4, 2025 · 9 min read · In an earlier article, I demonstrated the use of DataLakeServiceClient from the Azure SDK to manage OneLake storage. In this post, we'll delve into leveraging ADLS Gen2 APIs to manage OneLake storage and retrieve metadata for underlying objects acros...
Join discussion
Dec 2, 2024 · 8 min read · I have worked on Azure Synapse Analytics quite extensively. Synapse Analytics should be your goto platform if you want a combination of Big data and Warehousing capabilities under a single roof. There are two major components in Synapse Analytics Ser...
Join discussion
Oct 29, 2024 · 2 min read · In today’s data-driven world, the volume of unstructured and structured data continues to grow at an exponential rate. Azure Data Lake Storage Gen2 (ADLS Gen2) is a solution designed to handle this surge in data. With the scalability of a data lake a...
Join discussion
Mar 13, 2024 · 6 min read · What is DBFS? DBFS stands for Databricks File System. It's a distributed file system that's part of the Databricks Unified Data Analytics Platform. DBFS provides a scalable and reliable way to store data across various Databricks clusters. It's desig...
Join discussion
Mar 1, 2024 · 5 min read · Introduction When searching on your preferred search engine for accessing ADLS Gen 2 from a Databricks notebook, it will probably give you this great reference. In this blog, we aim to consolidate and simplify these methods, providing clear instructi...
Join discussion