CDC into a lakehouse: Change Data Feed, MERGE, and not reprocessing everything
Most pipelines start append-only, and for a while that is fine. Data arrives, you add it to the table, life is simple. Then the source starts sending updates to records you already have, and deletes f
sapotacorpvn.hashnode.dev7 min read