May 8 路 27 min read 路 馃搳 Step 1: Understanding the Dataset Before jumping into AWS services, it鈥檚 important to understand the dataset we鈥檙e working with. This project uses a retail shopping dataset that contains transactio
Join discussion
Oct 16, 2025 路 6 min read 路 The AWS Summit Bangalore, which I got the chance to attend on May 8, 2025, was an amazing learning experience. The summit gathered together cloud enthusiasts, developers, and architects to discuss the newest developments in AI and cloud computing. Al...
Join discussion
Oct 16, 2025 路 7 min read 路 AWS Application Load Balancer (ALB) logs are a critical source of information for troubleshooting, security analysis, and performance optimization. These logs capture detailed information about every request processed by our load balancer, including ...
Join discussion
May 11, 2025 路 6 min read 路 Hi Data Folks! 馃憢 In this blog, we鈥檒l walk through setting up AWS Athena for querying data in S3, defining table structures using both manual metadata and Glue Crawlers, and optimizing query performance with techniques like partitioning and columnar ...
Join discussion
Apr 17, 2025 路 7 min read 路 Introduction Context and Background The project was initiated to address the challenge of efficiently collecting, storing, and analyzing NBA sports data for advanced sports analytics. The organizational pain points included the lack of a centralized,...
Join discussion
Feb 24, 2025 路 5 min read 路 What is Partitioning? In the context of data warehousing and querying, partitioning is the process of dividing a large dataset into smaller, more manageable parts based on the values of one or more columns, known as partition keys. This division allo...
Join discussion
Oct 17, 2024 路 8 min read 路 Are you ready to explore the fascinating world of data lakes? Data Lake Integration with Amazon EMR, Redshift, and Athena is your ticket to mastering massive data management. These powerful AWS tools make integrating data lakes a cinch. You'll gather...
Join discussion
Sep 17, 2024 路 11 min read 路 Introduction In today鈥檚 data-driven world, companies need to process large volumes of data quickly and efficiently to derive meaningful insights. As a data engineer, you鈥檙e tasked with building robust, scalable systems that extract, transform, and lo...
Join discussion
Aug 2, 2024 路 3 min read 路 Introduction Virtual Private Cloud (VPC) Flow Logs are a critical feature for monitoring and troubleshooting network connectivity in AWS. In this blog post, we will delve into VPC Flow Logs, including how to set them up and analyze them using Amazon ...
Join discussion
Jul 29, 2024 路 8 min read 路 Serverless architectures are becoming a popular choice due to their ability to scale easily and potentially reduce costs. Services like AWS Lambda, S3, and API Gateway offer a range of benefits, making it easier to manage applications and infrastruct...
Join discussion
