KDKarthik Darbhaintech4nirvana.com·3d ago · 11 min readAI-Driven Data Quality: From Rules to ReasoningEvery data engineering team has a version of the same story. A critical dashboard starts showing numbers that don't feel right. An analyst flags it Friday afternoon. The on-call engineer traces it bac00
KDKarthik Darbhaintech4nirvana.com·May 31 · 7 min readThe Case for AI in Data Engineering Series: AI-Augmented Data Engineering | Article 1 of 7 There is a quiet crisis in most data engineering teams. Pipelines fail at 2 AM. The on-call engineer spends three hours tracing a root cause tha00
KDKarthik Darbhaintech4nirvana.com·May 14 · 11 min readThe Art of Program Visibility: Managing Databricks + Azure Data Programs at ScaleThe Invisible Failure Most data platform programs don't fail loudly. They fail quietly — one missed dependency, one unreported pipeline issue, one status update that said 'green' while the underlying 10
KDKarthik Darbhaintech4nirvana.com·May 5 · 11 min readLetting Go of Control: What Advaita Teaches Us About Liquid ClusteringThere is a pattern in mature engineering: the more you try to control, the more brittle the system becomes. Liquid Clustering is Delta Lake's answer to over-engineering. Vedanta figured this out mille00
KDKarthik Darbhaintech4nirvana.com·Apr 28 · 15 min readUnity Catalog - the Unified SelfBy Karthik Darbha | Tech4Nirvana The Problem of Many Selves In the Advaita Vedanta tradition, the root cause of all suffering is Avidya (अविद्या) — ignorance. Not ignorance in the ordinary sense of n00