Anuj Syalanujsyal.com·Feb 26, 2024How I Passed Databricks Data Engineer Professional ExamIntroduction You've aced the Databricks Data Engineer Associate Exam – congrats! Or maybe, you’re just curious as you heard someone becoming a Certified Data Engineering Professional. Guess it’s time to set your data engineering career in motion. But...Discuss·114 readsDatabricks
Stefan StarkeforCloudflight Engineering Blogengineering.cloudflight.io·Feb 14, 2024Lakehouse: Securing data accessIn this article, we'll delve into best practices for securing data access when using Microsoft Fabric Lakehouses. The goal is ensuring that your valuable data remains protected and enable people from within your organization to see subsets of the dat...Discuss·192 readsfabric
Sandeep PawarProfabric.guru·Nov 19, 2023Programmatically Creating, Managing Lakehouses in FabricAt MS Ignite, Microsoft unveiled a variety of new APIs designed for working with Fabric items, such as workspaces, Spark jobs, lakehouses, warehouses, ML items, and more. You can find detailed information about these APIs here. These APIs will be cri...Discuss·1.7K readslakehouse
Sandeep PawarProfabric.guru·Sep 23, 2023🚀Lightning Fast Copy In Fabric NotebookIf you are familiar with mssparkutils , you know that it is packed with utilities to perform common notebook tasks such as getting a list of files and folders, mount points, copying files, running notebooks etc. in Fabric. The Fabric notebook team ha...Discuss·3 likes·1.3K readsmicrosoft fabric
Sandeep PawarProfabric.guru·Aug 27, 2023Creating Shortcut To KQL Table In Fabric LakehouseShortcuts in Microsoft Fabric are one of the best features that allow you to point to any location on OneLake from any engine without moving the original data. It just magically makes it appear virtually via embedded references within OneLake. The of...Sandeep Pawar and 1 other are discussing this2 people are discussing thisDiscuss·448 readsKQL
JTProchatjpt.blog·Aug 21, 2023Part 2: Spice Up Your Fabric Data Pipeline with Variables and ExpressionsWelcome to our second video in the series! In this video, we'll show you how to spice up your data pipeline by using variables and expressions. By making a few changes to the pipeline we created in the previous video, we can dynamically insert values...Discuss·10 likes·50 readsA Microsoft Fabric Data Factory exploration using Google Scholar/SERPAPIdata
JTProchatjpt.blog·Aug 20, 2023Part 1: Taming Google Scholar Data using Microsoft FabricIntroduction Welcome to our blog post on taming Google Scholar data using Microsoft Fabric Data Pipelines. In this series of videos, we will guide you through a mini project where we leverage data pipelines in Microsoft Fabric to extract and transfor...Discuss·58 readsA Microsoft Fabric Data Factory exploration using Google Scholar/SERPAPIdata
Sandeep PawarProfabric.guru·Aug 13, 2023Recursively Loading Files From Multiple Workspaces And Lakehouses in FabricImagine a scenario in which you are collaborating with two colleagues who have stored sales data in two separate lakehouses, each within a different workspace and under distinct names but same schema. The data is saved in folders containing numerous ...Discuss·2 likes·1.1K readslakehouse
Sandeep PawarProfabric.guru·Aug 9, 2023Calculating Folder Size In The LakehouseThis is more of a personal note to self than a blog post. When running various test scenarios, I calculate the size of the lakehouse by calculating the size of its folders (Files and Tables). The code I use is below. I'm sharing it here to save mysel...Discuss·431 readsmicrosoft fabric
Sandeep PawarProfabric.guru·Jun 16, 2023Using The Lakehouse Connector In Power BI DesktopLakehouse Connector You can use the Lakehouse connector in Power BI Desktop to connect to the Fabric lakehouse. Depending on your scenario, you can connect to the default dataset in Direct Lake mode or to the SQL endpoint. Direct Lake Mode For each ...Discuss·2 likes·2.0K readslakehouse