@pulkitkapoor

Apache Hadoop — Background

May 20, 2025 · 5 min read · Technologies come and go, but data is here to grow! Introduction Data is the core of every modern application, driving insights, automation, and user experiences. Over time, technologies have evolved

AWS EMR – Private Subnets

Apr 9, 2025 · 4 min read · Introduction In this guide, we’ll walk through creating an Amazon EMR cluster in a private subnet using Terraform. By placing your EMR cluster in a private subnet, you prevent it from being directly accessible from the internet — improving both secur...

Apache Spark Unified Memory

Mar 27, 2025 · 3 min read · Introduction Apache Spark, a powerful distributed processing engine, relies heavily on memory management for optimal performance.The Unified Memory Manager (UMM) — introduced in Spark 1.6 — plays a ke

Serverless Framework

Mar 5, 2025 · 4 min read · Introduction In this series, we’ll focus on Serverless Framework, one of the fastest ways to build and deploy serverless applications. If you’ve already worked with Terraform, you know how great it is

AWS S3 Multi-Part Uploads

Feb 20, 2025 · 4 min read · Once you’ve created an S3 bucket, you’ll likely need to transfer large files — sometimes in the order of gigabytes or even terabytes. AWS S3 allows object sizes of up to 5 TB, but a single PUT upload is limited to 5 GB. To handle larger uploads, S3 o...