PPipeline Whiteboard18h ago · 9 min readChange Data Capture (CDC) Explained: From the Transaction Log to a Snowflake MERGEYour sales dashboard says there are 500 units in stock. Run a query against production and you get 12. Nobody broke anything. The nightly batch job ran nine hours ago, and in those nine hours the prodpipelinewhiteboard.hashnode.dev
AAriftly3d ago · 5 min readOracle to Snowflake migration validation: a six-gate acceptance frameworkOriginally published by Ariftly. This version focuses on the engineering method. The test scenarios below are synthetic specifications, not executed benchmark results. A successful SQL conversion ansariftly.hashnode.dev
AAira FrancoOct 6 · 11 min readLearning Data Orchestration with DagsterUp to this point in my data engineering project, I had already worked with the individual parts of a modern data stack: dlt for ingestion, Snowflake for storage, dbt for transformation, and dbt tests dataengineeringlearning.hashnode.dev
AAira FrancoOct 5 · 20 min readInside a Modern Data Warehouse Lifecycle: Snowflake, dlt, dbt, and Data ModelingThis blog walks through the full lifecycle of a modern data warehouse, from setting up Snowflake infrastructure and access control to ingesting API data with dlt, transforming it with dbt, modeling it1dataengineeringlearning.hashnode.dev
UUpStepSep 24 · 9 min readIs the Cheaper AI Model Good Enough? How to Make an Engineering DecisionYour support-ticket classifier works in a demonstration. Then your manager asks: “Can we switch to a cheaper AI model?” You try five tickets. Both models give sensible answers. But what happens to an upstepasia.hashnode.dev
AAlexSep 24 · 11 min readHow to Design a Snowflake Data Warehouse for HealthcareSnowflake can handle healthcare analytics workloads well. The harder part is everything around it. Patient records arrive from systems that disagree about identifiers. Some feeds follow FHIR closely, this-shitty-outsourcing.hashnode.dev
LLászló HadházySep 17 · 16 min readSnowflake external lineage keeps addressing, not meaningOn 3 September 2026 Snowflake moved external lineage to general availability. Send it OpenLineage events over REST and it will place objects that live outside Snowflake — an S3 prefix, a Postgres tablcordata.hashnode.dev
VVishnu NukalaSep 6 · 7 min readWhat If Your Food Delivery App Could Just... Understand You?A few weeks ago I was doing what most of us do at 9 PM — scrolling through a food delivery app, trying to decide what to order. Filters. Ratings. Endless scrolling through the same restaurants. At somvishnunukala.hashnode.dev
JJackson MumoSep 3 · 8 min readThe Trouble with Universal IDs: Part 2Part 1 ended on a question the coordinating strategies couldn't answer: can any machine, anywhere, produce a globally unique ID that also sorts by creation time, with nothing to check with? Twitter anmumojack.hashnode.dev
NNasim Hossain RabbiAug 6 · 8 min readHow Twitter Solved Distributed ID Generation"Generating an ID is easy." Is it, though? Every second, companies like Amazon, Stripe, Uber, Discord, and Netflix create millions of new records. Every order, payment, message, notification, and user6blog.nasimhossain.dev
