---
title: "Muhammad Atif Hafeez (@matifhafeez) | Hashnode"
description: "Software Architect. Read the latest articles by Muhammad Atif Hafeez on Hashnode."
url: "https://hashnode.com/@matifhafeez"
---

@matifhafeez

# Muhammad Atif Hafeez

@matifhafeez · Joined December 2024

Software Architect

### [⚠️ How I Diagnosed and Fixed a Silent NumPy Upgrade That Broke My Databricks Pipelines](https://databricks-library-dependency-hell.hashnode.dev/how-i-diagnosed-and-fixed-a-silent-numpy-upgrade-that-broke-my-databricks-pipelines?utm_source=hashnode&utm_medium=feed)

Background Recently, one of our critical ADF production pipelines failed unexpectedly with the following error from the Databricks notebook activity: "Could not reach driver of cluster 0619-120457-7gl1w8rb." The notebook had been working fine earli...

3 min read · [databricks-library-dependency-hell.hashnode.dev](https://databricks-library-dependency-hell.hashnode.dev/how-i-diagnosed-and-fixed-a-silent-numpy-upgrade-that-broke-my-databricks-pipelines?utm_source=hashnode&utm_medium=feed)

[Jul 10, 2025](https://hashnode.com/posts/how-i-diagnosed-and-fixed-a-silent-numpy-upgrade-that-broke-my-databricks-pipelines/686fadf507f537162d7ed88d)

### [From Raw Data to Customer Insights: My Journey Building a Scalable Segmentation Model Using PySpark & K-Means](https://customersegmentation.hashnode.dev/from-raw-data-to-customer-insights-my-journey-building-a-scalable-segmentation-model-using-pyspark-and-k-means?utm_source=hashnode&utm_medium=feed)

Intro: In this post, I’ll walk you through a customer segmentation project I recently completed using PySpark. The goal was to identify distinct customer groups based on behavioral and engagement features to support personalized marketing strategies...

3 min read · [customersegmentation.hashnode.dev](https://customersegmentation.hashnode.dev/from-raw-data-to-customer-insights-my-journey-building-a-scalable-segmentation-model-using-pyspark-and-k-means?utm_source=hashnode&utm_medium=feed)

[Apr 23, 2025](https://hashnode.com/posts/from-raw-data-to-customer-insights-my-journey-building-a-scalable-segmentation-model-using-pyspark-and-k-means/6808b37cb93c028067ffe006)

### [Implementing SCD Type 2 Using Spark SQL and Delta Tables](https://databrickssparksqlscdtype2.hashnode.dev/implementing-scd-type-2-using-spark-sql-and-delta-tables?utm_source=hashnode&utm_medium=feed)

In this blog, I will walk you through a straightforward approach to implementing Slowly Changing Dimension (SCD) Type 2 using Spark SQL and Delta Tables. This method ensures atomicity and maintains the history of records effectively. Introduction to ...

5 min read · [databrickssparksqlscdtype2.hashnode.dev](https://databrickssparksqlscdtype2.hashnode.dev/implementing-scd-type-2-using-spark-sql-and-delta-tables?utm_source=hashnode&utm_medium=feed)

[Feb 21, 2025](https://hashnode.com/posts/implementing-scd-type-2-using-spark-sql-and-delta-tables/67b83c0e7da9d6f689b7d91a)

### [Connect Azure Data Factory to On-Prem Data Sources](https://adf-connect-to-on-prem-data-sources.hashnode.dev/connect-azure-data-factory-to-on-prem-data-sources?utm_source=hashnode&utm_medium=feed)

Introduction Azure Data Factory (ADF) is a powerful cloud-based data integration service that allows you to create, schedule, and orchestrate data workflows. In this blog, I’ll demonstrate how I extended an existing Azure Data Engineering project (or...

5 min read · [adf-connect-to-on-prem-data-sources.hashnode.dev](https://adf-connect-to-on-prem-data-sources.hashnode.dev/connect-azure-data-factory-to-on-prem-data-sources?utm_source=hashnode&utm_medium=feed)

[Dec 25, 2024](https://hashnode.com/posts/connect-azure-data-factory-to-on-prem-data-sources/676c4d3a54fe59e86eb5021e)
