© 2026 Hashnode
I did not want a heavy data platform. I wanted a stack that was simple enough to ship quickly, cheap enough to run, and flexible enough to grow later. Character Design I tend to choose practical tool

Introduction In many years, the conventional way to develop data pipelines in Dagster with Apache Spark is submitting applications, which pose unique challenges to developers: Require a separate infrastructure (cluster of machines with a cluster man...
