Sandeep PawarProfabric.guru·Aug 27, 2023Creating Shortcut To KQL Table In Fabric LakehouseShortcuts in Microsoft Fabric are one of the best features that allow you to point to any location on OneLake from any engine without moving the original data. It just magically makes it appear virtually via embedded references within OneLake. The of...Discuss·116 readsKQL
JTProchatjpt.blog·Aug 21, 2023Part 2: Spice Up Your Fabric Data Pipeline with Variables and ExpressionsWelcome to our second video in the series! In this video, we'll show you how to spice up your data pipeline by using variables and expressions. By making a few changes to the pipeline we created in the previous video, we can dynamically insert values...Discuss·10 likes·31 readsA Microsoft Fabric Data Factory exploration using Google Scholar/SERPAPIdata
JTProchatjpt.blog·Aug 20, 2023Part 1: Taming Google Scholar Data using Microsoft FabricIntroduction Welcome to our blog post on taming Google Scholar data using Microsoft Fabric Data Pipelines. In this series of videos, we will guide you through a mini project where we leverage data pipelines in Microsoft Fabric to extract and transfor...DiscussA Microsoft Fabric Data Factory exploration using Google Scholar/SERPAPIdata
Sandeep PawarProfabric.guru·Aug 13, 2023Recursively Loading Files From Multiple Workspaces And Lakehouses in FabricImagine a scenario in which you are collaborating with two colleagues who have stored sales data in two separate lakehouses, each within a different workspace and under distinct names but same schema. The data is saved in folders containing numerous ...Discuss·2 likes·411 readslakehouse
Sandeep PawarProfabric.guru·Aug 9, 2023Calculating Folder Size In The LakehouseThis is more of a personal note to self than a blog post. When running various test scenarios, I calculate the size of the lakehouse by calculating the size of its folders (Files and Tables). The code I use is below. I'm sharing it here to save mysel...Discuss·102 readsmicrosoft fabric
Sandeep PawarProfabric.guru·Jun 16, 2023Using The Lakehouse Connector In Power BI DesktopLakehouse Connector You can use the Lakehouse connector in Power BI Desktop to connect to the Fabric lakehouse. Depending on your scenario, you can connect to the default dataset in Direct Lake mode or to the SQL endpoint. Direct Lake Mode For each ...Discuss·714 readslakehouse
Josue Luzardo Gebrimjosueluzardogebrim.hashnode.dev·Jun 14, 2023Dremio and Apache Iceberg: New Hope or Data Hype!?Hello Everyone, I started to look at the market and saw a growing use of Apache Iceberg, an amazing data format totally open-source and maintained and used by a huge community. With this opportunity, I observed a very common architecture of using Ice...Discussbig data
Sandeep PawarProfabric.guru·Jun 5, 2023Thoughts On Spaces In Workspace And Column Names in Microsoft FabricIf you are coming to Microsoft Fabric from Power BI, you will know that it's very common to have spaces in Workspace, Table and Column names to make them user-friendly. Power BI has no restriction on including spaces in names. For example, if you loo...Discuss·662 readsmicrosoftfabric
Sandeep PawarProfabric.guru·May 31, 2023How To Mount A Lakehouse and Identify The Mounted Lakehouse in Fabric NotebookLet's say you receive a notebook from someone that reads parquet file from some location in the OneLake. The code used to read the parquet is : How do you know where this parquet file folder was in the OneLake? Which workspace and which Lakehouse ? ...Discuss·414 readslakehouse
Sandeep PawarProfabric.guru·May 24, 2023Getting A List of Folders and Delta Tables in the Fabric LakehouseWhen you are working with the files and folders in Fabric, you will often need the list of file folders and tables for parameterization, data validation, DataOps, pipeline orchestration etc. Below is a quick helper function I have been using to get a...Discuss·370 readsfabric
