dbt: Bringing Software Engineering to Data Pipelines

Introduction Data pipelines are often an afterthought in organizations. They lack the rigor we apply to application code: Brittle: A single schema change upstream breaks everything downstream Unve