© 2026 Hashnode
What We're Building Key Features: Service Principal — Automated identity for CI/CD and secure deployments File Arrival Trigger — Job runs only when new files land Managed File Events — SNS/SQS fo

Databricks recently introduced a game-changing feature: the ability to publish tables to multiple schemas and catalogs from a single Lakeflow Declarative Pipeline (formerly Delta Live Tables / DLT). T

These days continuous integration (CI) and continuous delivery/deployment (CD) is used throughout most disciplines of software and data. Within the realms of data engineering and big data however, the implementations can at times be quite challenging...
