---
title: "Rahul R (@rahul-data) | Hashnode"
description: "Data Engineer. Read the latest articles by Rahul R on Hashnode."
url: "https://hashnode.com/@rahul-data"
---

@rahul-data

# Rahul R

@rahul-data · Bangalore, India · Joined September 2026

Data Engineer

### [How Delta Lake Is Built on Top of Amazon S3: Understanding the Architecture Behind It](https://rahul-dataeng.hashnode.dev/how-delta-lake-is-built-on-top-of-amazon-s3-understanding-the-architecture-behind-it?utm_source=hashnode&utm_medium=feed)

Understanding How Parquet Files and Transaction Logs Turn an S3 Data Lake into a Reliable Lakehouse.

8 min read · [rahul-dataeng.hashnode.dev](https://rahul-dataeng.hashnode.dev/how-delta-lake-is-built-on-top-of-amazon-s3-understanding-the-architecture-behind-it?utm_source=hashnode&utm_medium=feed)

[Nov 11](https://hashnode.com/posts/how-delta-lake-is-built-on-top-of-amazon-s3-understanding-the-architecture-behind-it/6af47b60c44e54ee6bdc37ab)

### [Amazon Neptune in Production: 7 Real-World Issues That Can Break Your Graph Database](https://rahul-dataeng.hashnode.dev/amazon-neptune-in-production-7-real-world-issues-that-can-break-your-graph-database?utm_source=hashnode&utm_medium=feed)

Troubleshooting slow Gremlin queries, connection exhaustion, request throttling, memory pressure, and failover challenges in AWS.

9 min read · [rahul-dataeng.hashnode.dev](https://rahul-dataeng.hashnode.dev/amazon-neptune-in-production-7-real-world-issues-that-can-break-your-graph-database?utm_source=hashnode&utm_medium=feed)

[Nov 3](https://hashnode.com/posts/amazon-neptune-in-production-7-real-world-issues-that-can-break-your-graph-database/6aea1d4f7d420db0d89473a1)

### [Stop Reprocessing Everything: Build Incremental Data Pipelines on AWS](https://rahul-dataeng.hashnode.dev/stop-reprocessing-everything-build-incremental-data-pipelines-on-aws?utm_source=hashnode&utm_medium=feed)

A Practical Guide to AWS Glue, PySpark, and S3 for Processing Only What Has Changed

12 min read · [rahul-dataeng.hashnode.dev](https://rahul-dataeng.hashnode.dev/stop-reprocessing-everything-build-incremental-data-pipelines-on-aws?utm_source=hashnode&utm_medium=feed)

[Oct 16](https://hashnode.com/posts/stop-reprocessing-everything-build-incremental-data-pipelines-on-aws/6ad2479331452b2a696fe7f8)

### [When Delta Lake Jobs Collide: Troubleshooting Concurrency Issues in AWS Glue](https://rahul-dataeng.hashnode.dev/when-delta-lake-jobs-collide-troubleshooting-concurrency-issues-in-aws-glue?utm_source=hashnode&utm_medium=feed)

Learn why concurrent DELETE, UPDATE, and MERGE operations fail in Delta Lake, and discover practical ways to debug transaction conflicts, prevent overlapping writes, and build more reliable AWS Glue data pipelines.

10 min read · [rahul-dataeng.hashnode.dev](https://rahul-dataeng.hashnode.dev/when-delta-lake-jobs-collide-troubleshooting-concurrency-issues-in-aws-glue?utm_source=hashnode&utm_medium=feed)

[Oct 12](https://hashnode.com/posts/when-delta-lake-jobs-collide-troubleshooting-concurrency-issues-in-aws-glue/6acca39ec13a8ac656801a58)

### [AWS Step Functions vs Apache Airflow: Similar Purpose, Different Use Cases](https://rahul-dataeng.hashnode.dev/aws-step-functions-vs-apache-airflow-similar-purpose-different-use-cases?utm_source=hashnode&utm_medium=feed)

They both orchestrate workflows, but they solve different problems. Let's understand when to use each.

7 min read · [rahul-dataeng.hashnode.dev](https://rahul-dataeng.hashnode.dev/aws-step-functions-vs-apache-airflow-similar-purpose-different-use-cases?utm_source=hashnode&utm_medium=feed)

[Oct 11](https://hashnode.com/posts/aws-step-functions-vs-apache-airflow-similar-purpose-different-use-cases/6acba8cccb68c86f3859f9b7)
