Dec 11, 2025 · 8 min read · When you work with data in Fabric Lakehouse, you need to understand two fundamental table types: managed tables and external tables. This distinction affects how your data is stored, accessed, and what happens when you delete tables. This article exp...
Join discussion
Jun 16, 2025 · 3 min read · Introduction Delta Lake, a powerful storage layer built on top of Apache Spark, brings ACID transactions and scalable metadata handling to big data. But like any persistent storage system, performance can degrade over time due to file fragmentation a...
Join discussionFeb 21, 2025 · 5 min read · In this blog, I will walk you through a straightforward approach to implementing Slowly Changing Dimension (SCD) Type 2 using Spark SQL and Delta Tables. This method ensures atomicity and maintains the history of records effectively. Introduction to ...
Join discussionNov 28, 2024 · 7 min read · In my previous two part article, I explained how Z order works and functions. You can read about it here and here. In this article, I will focus on demonstrating the practical implementation of optimization techniques for a delta table. I will demons...
Join discussion
Nov 8, 2024 · 9 min read · I have been sitting on this code for a long time. I shared the first version in one of my blogs on Direct Lake last year. I have been making updates to it since then as needed. I waited for the lakehouse schema to become available and then forgot to ...
MMicheal commentedJul 6, 2024 · 2 min read · Una tabla de dimensión Fecha es crucial para nuestros proyectos e informes analíticos. Es una tabla que no contiene mucha lógica y se puede crear en cualquier parte del proceso ETL. Con un sencillo script con PySpark y Spark SQL puedes crearla en tu ...
Join discussion
Jun 20, 2024 · 4 min read · Una de las claves para optar por Microsoft Fabric es poder llevar los datos desde bases de datos SQL Server locales. En este artículo veremos las diferentes opciones que nos ofrece Microsoft Fabric para mover los datos de nuestros servidores SQL Serv...
Join discussion
May 30, 2024 · 2 min read · Slowly Changing Dimensions (SCDs) are a vital concept in data warehousing, particularly in managing data that changes over time. As the entities evolve over time, it’s crucial to track and manage these changes effectively. This is where Slowly Changi...
Join discussion
Apr 3, 2024 · 5 min read · Introduction In the dynamic landscape of data analytics and processing, Databricks has emerged as a cornerstone platform, empowering organizations to extract valuable insights from vast datasets with unparalleled efficiency. Founded by the creators o...
Join discussion
Mar 16, 2024 · 4 min read · La evolución de esquemas en Delta Lake o Delta Lake Schema Evolution se centra en la gestión de cambios en la estructura de datos a lo largo del tiempo sin perturbar los flujos de datos existentes o requerir alteraciones en los datos almacenados. Est...
Join discussion