IWItay Waismanin1-db-2-rule-them-all.hashnode.dev·5d ago · 7 min readOne Storage Layer Isn't One Database: A Look at Databricks' LTAP"Every few years, a vendor with enough scale and engineering budget takes another run at the oldest unsolved problem in databases: can transactional and analytical workloads live on the same data witho00
PPPayal Patilinpayalpatil.hashnode.dev·Jul 5 · 3 min readWhy Climate Data Is Hard to TrustA few months ago, if someone had asked me what data looked like, I would have described it as rows, columns, APIs, databases, and dashboards. Today, I think of it differently. Data is a story. And lik00
BKBalaji Kottanaindatanarratives.hashnode.dev·Jul 4 · 14 min readSnowflake Clustering: When It Saves Money, When It Costs YouPlatform: Snowflake Topics: Clustering · Cardinality · Multi-column clustering · ROI analysis · Multiple non-correlated query patterns · FinOps The honest framing before we start Clustering is not a 10
BABlessing Angusindata-with-naza.hashnode.dev·Jul 2 · 9 min readData Tests, Quality Checks, and Observability: The Three Layers Every Pipeline NeedsIn Part 1 of this series, I defined data quality and walked through the six dimensions that the industry uses to measure it. If you have not read that piece, I would start there because the framework 00
HTHammad Tariqinthehammadtariq.hashnode.dev·Jul 1 · 3 min readAWS Athena Query Optimization: Scan Less and Cut Your BillIf you query an S3 data lake with Amazon Athena at any real volume, the cost can sneak up on you. There's no cluster to watch, so the spend stays invisible until the monthly bill arrives larger than e10
BABlessing Angusindata-with-naza.hashnode.dev·Jun 30 · 6 min readData Quality: What It Actually Means (And Why "Clean Data" Is Not Enough)Before I ever built a pipeline, I thought data quality meant clean data. Tidy spreadsheets. No empty cells. Consistent formatting. The kind of thing you could see and assess visually. Then I started a00
BKBalaji Kottanaindatanarratives.hashnode.dev·Jun 22 · 9 min readSnowflake Micro-Partitions: The storage unit that powers everythingPlatform: Snowflake · Parquet · Delta Lake · Iceberg · BigQuery · Redshift · ClickHouse Topics: Micro-partitions · No partial partition · Partition pruning · Column pruning · Columnar storage · Cross-30
KKKushneet Kaurincloudnativebykushneet.hashnode.dev·Jun 20 · 5 min readWhat is a Lakehouse? This article is part of the Databricks from Scratch series.Start from the beginning: Stop Optimising Your Prompts. Fix Your Data Pipelines. Picture this. It's IPL ticket booking day. 10 AM. 1 crore00
JPJaldeep Patelintech-blogs-by-jal.hashnode.dev·Jun 13 · 3 min readWhy Metadata-Driven ETL Frameworks Scale Better Than Hardcoded Pipelines — and Where They Don'tOver the years, I've seen many data platforms start with good intentions. A few scripts are created to move data from one system to another, and everything works fine. But as more vendors, APIs, and b00
MMediuswareinmediusware.hashnode.dev·Jun 12 · 10 min readPower BI vs Tableau: Choosing the Right Analytics PlatformMost companies do not fail at analytics because they picked a bad dashboard tool. They fail because their dashboards stop being trusted. One team reports one revenue number. Another team reports a dif00
