---
title: "Discussion on \"Machine Learning on Databricks for Data Engineers\" | Hashnode"
description: "Discussion on \"Machine Learning on Databricks for Data Engineers\". A data engineer's walkthrough of two end-to-end ML pipelines on Databricks : load, clean, train, save and score using Spark, tables and a little Python."
url: "https://hashnode.com/posts/machine-learning-on-databricks-for-data-engineers/6a980556f142c3b4c678b1bb"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Machine Learning on Databricks for Data Engineers](https://bidiaries.com/machine-learning-on-databricks-for-data-engineers?utm_source=hashnode&utm_medium=feed)

A data engineer's walkthrough of two end-to-end ML pipelines on Databricks : load, clean, train, save and score using Spark, tables and a little Python.

Sep 2 · 17 min read · bidiaries.com  
Updated Sep 4  
Read the article

-   [#databricks](https://hashnode.com/tag/databricks)
-   [#machine-learning](https://hashnode.com/tag/machine-learning)
-   [#data-engineering](https://hashnode.com/tag/data-engineering)
-   [#mlops](https://hashnode.com/tag/mlops)
-   [#pyspark](https://hashnode.com/tag/pyspark)
-   [#azure](https://hashnode.com/tag/azure)

## Written by

[Nalaka Wanniarachchi](https://hashnode.com/@nalakan)

@nalakan · Sri Lanka

  
[View profile](https://hashnode.com/@nalakan)

Your compass in the Data Universe | Data Whisperer

Data Architect specializing in modern analytics platforms across banking, education, and enterprise environments. Designing scalable lakehouse architectures with Microsoft Fabric, Azure, Databricks, Snowflake, and dbt, with strong expertise in Power BI, semantic modeling, DAX, and Power Query. Focused on building secure, high-performance, governed data platforms that enable real-time intelligence and self-service analytics, while exploring how GenAI and Azure AI bring practical intelligence into everyday analytics.

## Responses

Markdown supported · ⌘↵ to post

No responses yet.