Detail-oriented Data Engineer with 1.5 years of experience designing and maintaining data pipelines. Proficient in ETL processes and optimizing data for analytics. Adept at collaborating with cross-functional teams to deliver quality data solutions. Strong analytical skills with a passion for continuous learning and professional growth
Nothing here yet.
Aug 20, 2025 · 6 min read · Introduction In traditional databases like MySQL or PostgreSQL, we often use indexes to speed up data filtering and lookups. However, Amazon Redshift – being a columnar, massively parallel processing (MPP) data warehouse – works differently. Redshift...
Join discussionSep 5, 2024 · 5 min read · As data grows, managing costs becomes crucial for maintaining an efficient and scalable data infrastructure. AWS offers several options for data storage and querying, with Amazon Redshift and Amazon S3 being popular choices. In this blog, we'll explo...
Join discussionAug 17, 2024 · 3 min read · There are few approaches to achieve the delta loading in AWS. I will be discussing more about the two option here; Using Glue Job bookmark Using dynamodb to read unprocessed file Glue Job Bookmark Using job bookmark, AWS glue tracks data that has...
Join discussionJul 19, 2024 · 6 min read · Let's start by understanding what AWS CodePipeline is and what we can achieve with it. AWS CodePipeline is a powerful service that automates continuous delivery pipelines, enabling fast and reliable updates to your applications and infrastructure. Th...
Join discussionJun 11, 2024 · 3 min read · We can achieve the incremental loading using the spark data partition. I will be demonstrating with a simple example here, and you can you according to the business need. Let's consider the following data frame.(This could be your csv, or any formatt...
Join discussion