Sandeep Pawarfabric.guru·2 hours agoUpgrade Fabric Workspaces To The Latest GA RuntimeIt’s always a good idea to use the latest GA runtime for the default Spark pool in Fabric workspaces. Unless you change it manually, the workspace will always use the previously set runtime even if a new version is available. To help identify the run...Discuss·31 readsspark
Sachin Nandanwarwww.azureguru.net·a day agoIntegrating Livy API with Microsoft FabricLivy API is an open-source REST API that enables interaction with an Apache Spark cluster. It acts as a lightweight interface that allows developers to submit Spark jobs, manage their execution remotely through a RESTful interface and retrieve result...Discussmicrosoftfabric
Nalaka Wanniarachchibidiaries.com·Dec 10, 2024Maximizing Microsoft Fabric Capacity and PowerBI Licensing Cost:As businesses grow, so do their reporting needs, and managing Microsoft Fabric capacity alongside Power BI licensing can become quite complex. With the increasing demand for robust data models, seamless report generation, and broad access across user...DiscussFabricMicrosoft
Sandeep Pawarfabric.guru·Dec 10, 2024Using Fabric OrgApps + Notebooks For Geospatial Data ExplorationSimon Willison is one of my favorite bloggers. In fact, what I blog, how I blog & test, is inspired by him. He wrote a blog a couple of weeks ago about FourSquare Places data that has been open-sourced. I was exploring this dataset and ended up creat...Discuss·533 readsmicrosoftfabric
Sandeep Pawarfabric.guru·Dec 7, 2024Delta Lake Tables For Optimal Direct Lake Performance In Fabric Python NotebookIn my last blog, I showed how to use Polars in a Fabric Python notebook to read, write and transform data. What I did not cover was how to write a Delta Lake table in a Python notebook that’s optimal for DirectLake performance. All engines in Fabric ...Discuss·2 likes·1.2K readsmicrosoftfabricExcellent post, thank you for investing so much time in this! 3
Sachin Nandanwarwww.azureguru.net·Dec 6, 2024Service Principal for Microsoft Fabric Data PipelineIn the September 2024 Fabric update, support for Service Principal was made available. I had blogged about it some time ago where I demonstrated how Service Principal can be leveraged to query Fabric API’s. You can read it here. Also there was anothe...Discuss·1 likemicrosoftfabric
Sachin Nandanwarwww.azureguru.net·Dec 5, 2024COPY command in Microsoft FabricLet's say you want to import data from an ADLS2 or any other external storage location to a Fabric Data Warehouse on the fly instead of the usual data pipeline approach. Something you would want to do through SQL that provides lightspeed data ingesti...Discuss·46 readsmicrosoftfabric
Sandeep Pawarfabric.guru·Dec 4, 2024Working With Delta Tables In Fabric Python Notebook Using PolarsThe much-anticipated Python notebook in Fabric is finally available and the Fabric users have already developed cool libraries and blogged about the usefulness of these notebooks. Duckdb is everyone’s favorite, but I am a Python guy 😁 so here is qui...Discuss·962 readspython notebook
Ian Santillanievsantillan.hashnode.dev·Nov 30, 2024Real-Time Intelligence: now Generally AvailableMicrosoft has announced the general availability of Real-Time Intelligence within Microsoft Fabric, marking a significant advancement in data analytics capabilities. This feature empowers organizations to process and act upon high-volume, time-sensit...DiscussReal-time-intelligence
Sachin Nandanwarwww.azureguru.net·Nov 28, 2024Microsoft Fabric Delta Lake optimizationIn my previous two part article, I explained how Z order works and functions. You can read about it here and here. In this article, I will focus on demonstrating the practical implementation of optimization techniques for a delta table. I will demons...Discuss·64 readsmicrosoftfabric
