MMUQTADIRMALIK QUAZI·4h agoWhy pip install Fails on a Locked-Down Azure Databricks Workspace (and the Right Way to Fix It)The block is a security control, not a bug. Here is how it works, and how to give teams their libraries without opening the internet.7 min read·muqtadirmalik.hashnode.dev
MMing Yao (Michael)·1d agoWhen to skip Kafka and Event Hubs with Databricks Zerobus IngestZerobus Ingest lets your apps write straight into a Delta table. I looked at when that’s worth it, and when Kafka or Event Hubs still makes more sense.5 min read·mloh.hashnode.dev
SSai Prudhvi Neelakantam·3d agoFabric or Databricks? How I DecideI used AI tools to help draft and edit this post. I checked the facts and the wording, and the original lives at geekindata.com. The diagrams are on that page. Not a feature war. Five questions I ask9 min read·geekindata.hashnode.dev
SShubham Baldava·3d agoPostgres to Databricks CDC: Unity Catalog Setup and the Four Places It FailsSlot, grants, token, delete format and change sync in order, with the exact error text wherever Postgres or Databricks prints one.11 min read·olake-blog.hashnode.dev
AAritra Chakraborty·5d agoHow IFCO Cut a 7-Hour dbt Job to 2 Hours 20 Minutes on DatabricksA data pipeline does not need a radical rewrite to become dramatically faster. Sometimes, the biggest gains come from making an incremental model truly incremental—and finding out what the query engin4 min read·aidatalegends.hashnode.dev1S
MMUQTADIRMALIK QUAZI·Nov 8Which storage accounts belong to Databricks? Finding them with Unity Catalog, the CLI and AIA real platform-admin task: two metastores, a few SQL queries, one CLI command and an AI assistant6 min read·muqtadirmalik.hashnode.dev
MMUQTADIRMALIK QUAZI·Oct 28Who can reach your workspace? Context-based ingress in Azure DatabricksIP access lists only ask “where are you coming from?” Context-based ingress in Azure Databricks also asks who you are and what you’re trying to do for public traffic and, as of October 2026, for Priva5 min read·muqtadirmalik.hashnode.dev
AAritra Chakraborty·Oct 26Databricks Lakehouse Platform for Real-Time, Agentic Data and AI WorkloadsFederation, Lakeflow, Unity Catalog, Lakebase, AI Search and agents on one governed platform, with real-time patterns and limits.4 min read·aidatalegends.hashnode.dev
AAritra Chakraborty·Oct 26Databricks Runtime Introduces NEAREST BY: Native SQL Vector Search at ScaleBatch vector search in SQL with a fused Photon GEMM operator and IVF indexes in Delta tables: how it works and when to use it.4 min read·aidatalegends.hashnode.dev
AAritra Chakraborty·Oct 26Databricks SQL Serverless Cost Governance: Budgets, Alerts, and Query-Level AttributionBudgets, alerts, tags and usage dashboards: what they show, what they miss, and how to turn cost data into action.4 min read·aidatalegends.hashnode.dev