SPSudhanshu Prajapatiinblog.altimate.ai·4d ago · 21 min readBeyond the Databricks Cost Calculator: 6 Levers That Actually Cut Your Bill The official Databricks price calculator provides you information on the DBU rate times the hours you plan to run, the instance type for cloud providers, the costing of VMs (basically compute types) f00
MIMyData Insightsinmydatainsights-blogs.hashnode.dev·Sep 8 · 9 min readMedallion Architecture Explained: Bronze, Silver and Gold Layers The design review usually goes the same way. Somebody puts up a slide with three coloured rectangles, says "we'll follow the medallion architecture", and everyone nods. Six months later the Silver lay00
SASaurabh Arorainblog.altimate.ai·Sep 4 · 10 min readDatabricks Serverless vs Classic Compute: Which One Is Actually Cheaper?Whenever somebody mentions serverless, two things come to mind: it should be cheaper than normal resources and no infrastructure management, right? This is certainly what has been claimed both from Da00
NWNalaka Wanniarachchiinbidiaries.com·Sep 2 · 17 min readMachine Learning on Databricks for Data EngineersI built two models on Databricks from scratch — one predicts a used bike's price, and one predicts whether a loan will default. Both follow the same pattern: raw file → feature table → training → save30
MSManu Shuklainecorpit.hashnode.dev·Aug 23 · 13 min readDatabricks shipped agent-aware ABAC masking on 21 August 2026 with 3 gapsDatabricks shipped agent-aware ABAC masking on 21 August 2026 with 3 gaps Summary. Databricks put context attributes for Unity Catalog attribute-based access control into Beta on 21 August 2026. Two n00
SCSreekanth Cherpatiinunpack.hashnode.dev·Aug 22 · 9 min readDatabricks RBAC for Clinical and Biotech DataIntroduction: Life-sciences data platforms have changed substantially. A single Databricks environment can now support clinical development, real-world evidence, pharmacovigilance, biomarker research,00
MSManu Shuklainecorpit.hashnode.dev·Aug 22 · 12 min readDatabricks dbt refreshes just inherited your cost setting, and 4 to 6 minutes of startup latencyDatabricks dbt refreshes just inherited your cost setting, and 4 to 6 minutes of startup latency Summary. On 20 August 2026 Databricks changed how dbt tasks refresh materialized views and streaming ta00
MSManu Shuklainecorpit.hashnode.dev·Aug 22 · 12 min readDatabricks Supervisor API dies 30 September 2026, and it is not in the August release notesDatabricks Supervisor API dies 30 September 2026, and it is not in the August release notes Summary. Databricks has deprecated the Supervisor API and set its end of life at 30 September 2026, roughly 00
SASaurabh Arorainblog.altimate.ai·Aug 19 · 23 min readUnderstanding Databricks Compute CostsThere is so much around Databricks cost optimization techniques, strategies, approaches, what to do, what not to do, and many guides from authors, even official sources from Databricks. All of those c10
KDKarthik Darbhaintech4nirvana.com·Aug 16 · 10 min readRoot Cause Analysis Without the War Room1. The Problem A pipeline fails at 2 AM. The on-call engineer opens the job logs, sees a generic Spark exception, and starts the ritual: check the source table, check the schema, check the upstream jo10
