Feb 22 · 5 min read · Introduction Designing ETL pipelines in Apache Spark on Databricks is not just about writing transformations. It is about building a structured, scalable system that can evolve with changing business
Join discussionFeb 15 · 3 min read · אמ;לק ארכיטקטורת המדליון (Medalion Architecture) היא Framework לארגון נתונים בתוך Data Lake, המחלקת את המידע לשלוש שכבות לוגיות: Bronze (נתונים גולמיים), Silver (נתונים מנוקים ומנורמלים), Gold (נתונים עסקיים מוכנים לצריכה). היא פותרת את בעיית הנוקשות...
Join discussion
Feb 11 · 2 min read · Medallion Architecture has become the default blueprint for modern data platforms. Fabric promotes it.Databricks popularised it.Snowflake teams replicate it. But somewhere along the way, the clarity of the model started fading. Bronze, Silver, Gold b...
Join discussion
Jan 3 · 4 min read · Modern data teams don’t struggle with collecting data anymore — they struggle with trusting it. That’s exactly the problem dbt was built to solve. This post is a complete, end-to-end guide to dbt, covering: What problems it solves Core concepts (mo...
Join discussionDec 8, 2025 · 7 min read · In this article, we're going to demo a medallion architecture within a Fabric Lakehouse using notebooks. But before we jump into the code, I want to make sure you understand exactly what medallion architecture is, why it matters, and when to use it. ...
Join discussion
Dec 7, 2025 · 3 min read · Modern analytics platforms require structured and reliable data processing pipelines. The Medallion Architecture—Bronze → Silver → Gold—provides a standardized way to achieve this while maintaining quality, lineage, and re-processing capabilities. In...
Join discussion
Dec 1, 2025 · 10 min read · The call came at 5:14 AM. A bearing on production line 7 had failed, and the plant manager wanted to know why our "predictive maintenance system" hadn't caught it. I spent the next four hours tracing data from the dashboard back through our pipelines...
Join discussion
Nov 24, 2025 · 4 min read · ⚡ Data Activator - Alertas en tiempo real En esta sección exploraremos cómo utilizar Data Activator en Microsoft Fabric para monitorizar datos en tiempo real y generar alertas automáticas basadas en condiciones definidas sobre nuestras tablas, vistas...
Join discussion
Nov 6, 2025 · 9 min read · En esta sección abordaremos la fase de análisis y visualización de nuestro proyecto en tiempo real.El objetivo es transformar los datos procesados en la arquitectura Medallion en insights visuales que faciliten la toma de decisiones rápidas y basadas...
Join discussion
Oct 24, 2025 · 7 min read · 🎯 Objetivo En esta fase abordaremos la transformación, limpieza y preparación analítica de los datos obtenidos en la capa Bronze.El propósito es construir las capas Silver y Gold dentro de nuestra arquitectura Medallion, garantizando datos consisten...
Join discussion