---
title: "#databricks articles | Hashnode"
description: "Explore 246 articles tagged #databricks on Hashnode. Tutorials, guides, and how-tos from the community."
url: "https://hashnode.com/tag/databricks"
---

Tag

# #databricks

246 posts · 114 followers

[MUQTADIRMALIK QUAZI](https://hashnode.com/@muqtadirmalik) · [4h ago](https://hashnode.com/posts/why-pip-install-fails-on-a-locked-down-azure-databricks-workspace-and-the-right-way-to-fix-it/6afaa22077a711064cee54ce)

### [Why pip install Fails on a Locked-Down Azure Databricks Workspace (and the Right Way to Fix It)](https://muqtadirmalik.hashnode.dev/why-pip-install-fails-on-a-locked-down-azure-databricks-workspace-and-the-right-way-to-fix-it?utm_source=hashnode&utm_medium=feed)

The block is a security control, not a bug. Here is how it works, and how to give teams their libraries without opening the internet.

7 min read · [muqtadirmalik.hashnode.dev](https://muqtadirmalik.hashnode.dev/why-pip-install-fails-on-a-locked-down-azure-databricks-workspace-and-the-right-way-to-fix-it?utm_source=hashnode&utm_medium=feed)

[Ming Yao (Michael)](https://hashnode.com/@mikeloh) · [1d ago](https://hashnode.com/posts/databricks-zerobus-ingest-vs-kafka-event-hubs/6af8fb9fccc9571932961dbe)

### [When to skip Kafka and Event Hubs with Databricks Zerobus Ingest](https://mloh.hashnode.dev/databricks-zerobus-ingest-vs-kafka-event-hubs?utm_source=hashnode&utm_medium=feed)

Zerobus Ingest lets your apps write straight into a Delta table. I looked at when that’s worth it, and when Kafka or Event Hubs still makes more sense.

5 min read · [mloh.hashnode.dev](https://mloh.hashnode.dev/databricks-zerobus-ingest-vs-kafka-event-hubs?utm_source=hashnode&utm_medium=feed)

[Sai Prudhvi Neelakantam](https://hashnode.com/@geekindata) · [3d ago](https://hashnode.com/posts/fabric-or-databricks-how-i-decide/6af6d1c1489ad45056052fb5)

### [Fabric or Databricks? How I Decide](https://geekindata.hashnode.dev/fabric-or-databricks-how-i-decide?utm_source=hashnode&utm_medium=feed)

I used AI tools to help draft and edit this post. I checked the facts and the wording, and the original lives at geekindata.com. The diagrams are on that page. Not a feature war. Five questions I ask

9 min read · [geekindata.hashnode.dev](https://geekindata.hashnode.dev/fabric-or-databricks-how-i-decide?utm_source=hashnode&utm_medium=feed)

[Shubham Baldava](https://hashnode.com/@shubham-olake) · [3d ago](https://hashnode.com/posts/postgres-to-databricks-cdc-unity-catalog-setup-and-the-four-places-it-fails/6af6396c524ace1ebaaae867)

### [Postgres to Databricks CDC: Unity Catalog Setup and the Four Places It Fails](https://olake-blog.hashnode.dev/postgres-to-databricks-cdc-unity-catalog-setup-and-the-four-places-it-fails?utm_source=hashnode&utm_medium=feed)

Slot, grants, token, delete format and change sync in order, with the exact error text wherever Postgres or Databricks prints one.

11 min read · [olake-blog.hashnode.dev](https://olake-blog.hashnode.dev/postgres-to-databricks-cdc-unity-catalog-setup-and-the-four-places-it-fails?utm_source=hashnode&utm_medium=feed)

[Aritra Chakraborty](https://hashnode.com/@aidatalegends) · [5d ago](https://hashnode.com/posts/how-ifco-cut-a-7-hour-dbt-job-to-2-hours-20-minutes-on-databricks/6af3681b5454f0d485c2adb9)

### [How IFCO Cut a 7-Hour dbt Job to 2 Hours 20 Minutes on Databricks](https://aidatalegends.hashnode.dev/how-ifco-cut-a-7-hour-dbt-job-to-2-hours-20-minutes-on-databricks?utm_source=hashnode&utm_medium=feed)

A data pipeline does not need a radical rewrite to become dramatically faster. Sometimes, the biggest gains come from making an incremental model truly incremental—and finding out what the query engin

4 min read · [aidatalegends.hashnode.dev](https://aidatalegends.hashnode.dev/how-ifco-cut-a-7-hour-dbt-job-to-2-hours-20-minutes-on-databricks?utm_source=hashnode&utm_medium=feed)

[1](https://hashnode.com/posts/how-ifco-cut-a-7-hour-dbt-job-to-2-hours-20-minutes-on-databricks/6af3681b5454f0d485c2adb9)

[MUQTADIRMALIK QUAZI](https://hashnode.com/@muqtadirmalik) · [Nov 8](https://hashnode.com/posts/which-storage-accounts-belong-to-databricks-finding-them-with-unity-catalog-the-cli-and-ai/6af0ed930497f144f8aa2ab9)

### [Which storage accounts belong to Databricks? Finding them with Unity Catalog, the CLI and AI](https://muqtadirmalik.hashnode.dev/which-storage-accounts-belong-to-databricks-finding-them-with-unity-catalog-the-cli-and-ai?utm_source=hashnode&utm_medium=feed)

A real platform-admin task: two metastores, a few SQL queries, one CLI command and an AI assistant

6 min read · [muqtadirmalik.hashnode.dev](https://muqtadirmalik.hashnode.dev/which-storage-accounts-belong-to-databricks-finding-them-with-unity-catalog-the-cli-and-ai?utm_source=hashnode&utm_medium=feed)

[MUQTADIRMALIK QUAZI](https://hashnode.com/@muqtadirmalik) · [Oct 28](https://hashnode.com/posts/who-can-reach-your-workspace-context-based-ingress-in-azure-databricks/6ae17cffcc94571ca08b3b39)

### [Who can reach your workspace? Context-based ingress in Azure Databricks](https://muqtadirmalik.hashnode.dev/who-can-reach-your-workspace-context-based-ingress-in-azure-databricks?utm_source=hashnode&utm_medium=feed)

IP access lists only ask “where are you coming from?” Context-based ingress in Azure Databricks also asks who you are and what you’re trying to do for public traffic and, as of October 2026, for Priva

5 min read · [muqtadirmalik.hashnode.dev](https://muqtadirmalik.hashnode.dev/who-can-reach-your-workspace-context-based-ingress-in-azure-databricks?utm_source=hashnode&utm_medium=feed)

[Aritra Chakraborty](https://hashnode.com/@aidatalegends) · [Oct 26](https://hashnode.com/posts/databricks-lakehouse-platform-for-real-time-agentic-data-and-ai-workloads/6adf54b22498241548ffc04d)

### [Databricks Lakehouse Platform for Real-Time, Agentic Data and AI Workloads](https://aidatalegends.hashnode.dev/databricks-lakehouse-platform-for-real-time-agentic-data-and-ai-workloads?utm_source=hashnode&utm_medium=feed)

Federation, Lakeflow, Unity Catalog, Lakebase, AI Search and agents on one governed platform, with real-time patterns and limits.

4 min read · [aidatalegends.hashnode.dev](https://aidatalegends.hashnode.dev/databricks-lakehouse-platform-for-real-time-agentic-data-and-ai-workloads?utm_source=hashnode&utm_medium=feed)

[Aritra Chakraborty](https://hashnode.com/@aidatalegends) · [Oct 26](https://hashnode.com/posts/databricks-runtime-introduces-nearest-by-native-sql-vector-search-at-scale/6adf54823063e5668270e3ca)

### [Databricks Runtime Introduces NEAREST BY: Native SQL Vector Search at Scale](https://aidatalegends.hashnode.dev/databricks-runtime-introduces-nearest-by-native-sql-vector-search-at-scale?utm_source=hashnode&utm_medium=feed)

Batch vector search in SQL with a fused Photon GEMM operator and IVF indexes in Delta tables: how it works and when to use it.

4 min read · [aidatalegends.hashnode.dev](https://aidatalegends.hashnode.dev/databricks-runtime-introduces-nearest-by-native-sql-vector-search-at-scale?utm_source=hashnode&utm_medium=feed)

[Aritra Chakraborty](https://hashnode.com/@aidatalegends) · [Oct 26](https://hashnode.com/posts/databricks-sql-serverless-cost-governance-budgets-alerts-and-query-level-attribution/6adf544b2498241548ffbb49)

### [Databricks SQL Serverless Cost Governance: Budgets, Alerts, and Query-Level Attribution](https://aidatalegends.hashnode.dev/databricks-sql-serverless-cost-governance-budgets-alerts-and-query-level-attribution?utm_source=hashnode&utm_medium=feed)

Budgets, alerts, tags and usage dashboards: what they show, what they miss, and how to turn cost data into action.

4 min read · [aidatalegends.hashnode.dev](https://aidatalegends.hashnode.dev/databricks-sql-serverless-cost-governance-budgets-alerts-and-query-level-attribution?utm_source=hashnode&utm_medium=feed)
