AFAira Francoindataengineeringlearning.hashnode.dev·2d ago · 11 min readLearning Data Orchestration with DagsterUp to this point in my data engineering project, I had already worked with the individual parts of a modern data stack: dlt for ingestion, Snowflake for storage, dbt for transformation, and dbt tests 00
AFAira Francoindataengineeringlearning.hashnode.dev·3d ago · 20 min readInside a Modern Data Warehouse Lifecycle: Snowflake, dlt, dbt, and Data ModelingThis blog walks through the full lifecycle of a modern data warehouse, from setting up Snowflake infrastructure and access control to ingesting API data with dlt, transforming it with dbt, modeling it10
SLSean Liuinzhaidata.com·Sep 10 · 7 min readMy semantic layer answers this question confidently. The answer is ambiguous.I'm building an evaluation harness for AI-generated SQL. While simplifying my semantic layer, I accidentally removed a guardrail I didn't know I had — and discovered a class of question that conventio00
VNVishnu Nukalainvishnunukala.hashnode.dev·Sep 6 · 7 min readWhat If Your Food Delivery App Could Just... Understand You?A few weeks ago I was doing what most of us do at 9 PM — scrolling through a food delivery app, trying to decide what to order. Filters. Ratings. Endless scrolling through the same restaurants. At som00
SLSean Liuinzhaidata.com·Sep 3 · 6 min readThe definitions document isn't documentation. It's an accuracy interventionIn a previous post I showed that column descriptions improve the accuracy of AI-generated SQL but don't make it deterministic. This is the follow-up: what happens when you go further and give the mode10
DRDor Rafael Avrahamofinoptipipe.hashnode.dev·Aug 8 · 4 min readWhy I stopped guessing at Spark and dbt config valuesI've spent more than a decade building data pipelines, and the part nobody warns you about isn't the pipeline logic. It's the tuning. Executor memory, shuffle partitions, cluster size, thread counts. 00
AGAnand Guptainblog.altimate.ai·Aug 2 · 11 min readPower User for dbt Can Now Tell You Why Your Model Is SlowThe queries that cost you money usually aren't the ones anyone complains about. A dbt model ships to prod looking fine, then scans ten times the data it needs on every scheduled run for the next six m31T
ASajay singh rathoreinajay990.hashnode.dev·Jul 31 · 9 min readdbt Series #5: Get start with Data ConstraintsA practical guide to defining, enforcing, and validating data integrity rules in your dbt models Introduction If you're coming to dbt from a SQL background, you're probably familiar with constraints a00
MSManu Shuklainecorpit.hashnode.dev·Jul 31 · 14 min readBigQuery Data Engineering Agent vs dbt and Dataform in 2026: should you let AI write your pipelines?BigQuery Data Engineering Agent vs dbt and Dataform in 2026: should you let AI write your pipelines? Summary. Google moved the BigQuery Data Engineering Agent to general availability on 22 April 2026,00
ASajay singh rathoreinajay990.hashnode.dev·Jul 30 · 6 min readdbt Series #4: Data Contracts – Defining What Your Data Should Look LikeIf you've worked with SQL long enough, you've probably experienced this frustration: you build a query that depends on specific columns existing in a table, with specific data types, only to have some00
