---
title: "#mappartitions articles | Hashnode"
description: "Explore 1 articles tagged #mappartitions on Hashnode. Tutorials, guides, and how-tos from the community."
url: "https://hashnode.com/tag/mappartitions"
---

Tag

# #mappartitions

1 posts · 0 followers

[Ömer Oruç ÇELİK](https://hashnode.com/@detail-pipelines) · [Mar 6](https://hashnode.com/posts/optimizing-pyspark-on-aws-glue-with-the-yield-pattern/69aa922d78c5adcd0ee668b2)

### [From 3,600 to 400 API Calls: Optimizing PySpark on AWS Glue with the Yield Pattern](https://oorucelik.hashnode.dev/optimizing-pyspark-on-aws-glue-with-the-yield-pattern?utm_source=hashnode&utm_medium=feed)

How I used Python generators and RDD mapPartitions to enrich data from 2 APIs and write 9 staging tables — in a single Spark job.

9 min read · [oorucelik.hashnode.dev](https://oorucelik.hashnode.dev/optimizing-pyspark-on-aws-glue-with-the-yield-pattern?utm_source=hashnode&utm_medium=feed)
