Mar 26 · 9 min read · So I gave myself a challenge, to build a production-grade data pipeline from scratch, using real industry tools, at zero cost, and document every stumble along the way. This is that story. The Proble
Join discussion
Feb 22 · 5 min read · Introduction Designing ETL pipelines in Apache Spark on Databricks is not just about writing transformations. It is about building a structured, scalable system that can evolve with changing business
Join discussionFeb 15 · 3 min read · אמ;לק ארכיטקטורת המדליון (Medalion Architecture) היא Framework לארגון נתונים בתוך Data Lake, המחלקת את המידע לשלוש שכבות לוגיות: Bronze (נתונים גולמיים), Silver (נתונים מנוקים ומנורמלים), Gold (נתונים עסקיים מוכנים לצריכה). היא פותרת את בעיית הנוקשות...
Join discussion
Feb 11 · 2 min read · Medallion Architecture has become the default blueprint for modern data platforms. Fabric promotes it.Databricks popularised it.Snowflake teams replicate it. But somewhere along the way, the clarity of the model started fading. Bronze, Silver, Gold b...
Join discussion
Jan 3 · 4 min read · Modern data teams don’t struggle with collecting data anymore — they struggle with trusting it. That’s exactly the problem dbt was built to solve. This post is a complete, end-to-end guide to dbt, covering: What problems it solves Core concepts (mo...
Join discussionDec 8, 2025 · 7 min read · In this article, we're going to demo a medallion architecture within a Fabric Lakehouse using notebooks. But before we jump into the code, I want to make sure you understand exactly what medallion architecture is, why it matters, and when to use it. ...
Join discussion
Dec 7, 2025 · 3 min read · Modern analytics platforms require structured and reliable data processing pipelines. The Medallion Architecture—Bronze → Silver → Gold—provides a standardized way to achieve this while maintaining quality, lineage, and re-processing capabilities. In...
Join discussion
Dec 1, 2025 · 10 min read · The call came at 5:14 AM. A bearing on production line 7 had failed, and the plant manager wanted to know why our "predictive maintenance system" hadn't caught it. I spent the next four hours tracing data from the dashboard back through our pipelines...
Join discussion
Nov 24, 2025 · 4 min read · ⚡ Data Activator - Alertas en tiempo real En esta sección exploraremos cómo utilizar Data Activator en Microsoft Fabric para monitorizar datos en tiempo real y generar alertas automáticas basadas en condiciones definidas sobre nuestras tablas, vistas...
Join discussion
