---
title: "Discussion on \"Scaling Big Data Processing in the Cloud: Proven Practices with Spark & Ray\" | Hashnode"
description: "Discussion on \"Scaling Big Data Processing in the Cloud: Proven Practices with Spark & Ray\". How to build shared, elastic and isolated data pipelines on the cloud using Python, Spark and Ray"
url: "https://hashnode.com/posts/scaling-big-data-processing-in-the-cloud-proven-practices-with-spark-and-ray/691ddc96d8c9ed97c927542a"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Scaling Big Data Processing in the Cloud: Proven Practices with Spark & Ray](https://qtmuniao.hashnode.dev/scaling-big-data-processing-in-the-cloud-proven-practices-with-spark-and-ray?utm_source=hashnode&utm_medium=feed)

How to build shared, elastic and isolated data pipelines on the cloud using Python, Spark and Ray

Nov 19, 2025 · 8 min read · qtmuniao.hashnode.dev  
Read the article

-   [#data-processing](https://hashnode.com/tag/data-processing)
-   [#ray](https://hashnode.com/tag/ray)
-   [#spark](https://hashnode.com/tag/spark)
-   [#cloud](https://hashnode.com/tag/cloud)
-   [#distributed-system](https://hashnode.com/tag/distributed-system)

## Written by

[muniao](https://hashnode.com/@qtmuniao)

@qtmuniao

  
[View profile](https://hashnode.com/@qtmuniao)

Distributed system, Database, Storage

A software engineer focus on large-scale data system, including data processing, storage and databases.

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
