Abheshekh Akulathrilling-aws-iot-pipeline-journey.hashnode.dev·Jan 30, 2025Complete Guide to Automating AWS IoT Pipelines: A Thrilling JourneyIn the fast-evolving world of IoT, managing the relentless flow of data from MQTT topics into a scalable IoT pipeline is no small feat. This is the story of how I built one such pipeline using AWS Kinesis, Lambda, Glue Catalog, and S3, transforming r...aws io
Olugbenga Ajayigbejula.hashnode.dev·Jan 22, 2025Building an NBA Data Lake projectIntroduction This is the Day 3 of DevopsAllStarsChallenge This project automates the creation of a data lake for NBA analytics using AWS services. A Python script integrates Amazon S3, AWS Glue, and AWS Athena, and sets up the infrastructure needed t...1 like·30 readsAWS
Amit Sidesamitsides.hashnode.dev·Jan 18, 2025A Complete Guide for Building ML Pipeline with Athena, SQS, EKS, Keda & SageMaker[ Included: the architecture, YAMLs, and Python Code for the 2 microservices (Athena→SQS & SQS→SageMaker) to make this pipeline work. ] Secured Data Pipeline: Secure your (Athena, SQS) Credentials in Vault/Secret Manager for the Pods to Query Them P...1 likeEKS
Blessing Aliublessingaliu.hashnode.dev·Jan 13, 2025🌤️ Day 3: NBA Sports Analytics Data Lake SetupThis project showcases how to build a powerful NBA Data Lake on AWS for analyzing basketball data, leveraging key AWS services to store, process, and query the data. 🔹 Amazon S3 – for storing raw and processed data 🔹 AWS Glue – for seamless data ca...1 like30 Day DevOps Challenge | DevOpsAllStarsChallengeathena
Tanishka Marrottcloud-design-diaries.hashnode.dev·Aug 4, 2024Real-Time Streaming Analytics Pipeline with Kinesis, Flink, and OpenSearch 🚀Hi there 👋, I'm Tanishka Marrott Today, I'll be taking you through an exciting journey where we've seamlessly integrated the primary phases of data ingestion, processing, storage, and visualization into a single cohesive pipeline using AWS services ...1 likeAWS
Sanket Nimkarsanketnmkr.hashnode.dev·Jul 29, 2024Cost Optimization Strategies for Serverless ArchitecturesServerless architectures are becoming a popular choice due to their ability to scale easily and potentially reduce costs. Services like AWS Lambda, S3, and API Gateway offer a range of benefits, making it easier to manage applications and infrastruct...1 like·29 readsAWS
Akshada Kakdeakshada.hashnode.dev·Jul 1, 2024Optimizing Data Analytics with AWS Athena: A Step-by-Step GuideIntroduction Amazon Athena is an interactive query service that you can use to analyze the data present in Amazon S3 Bucket. Data can be queried using standard SQL. You can quickly query large datasets stored in S3 without the need for complex data p...1 like·47 readsAWS
Chandrasekar(Chan) Rajaramcr88.hashnode.dev·May 31, 2024Automating Data Processing with AWS: From S3 Upload to QuickSight DashboardIn today's fast-paced financial environment, having timely and accurate data is crucial for making informed decisions. Automating data processing workflows can significantly enhance efficiency and ensure that stakeholders always have access to the la...83 readsAWS
Saloni Singhsalonisingh.hashnode.dev·Apr 21, 2024Learning AWS Day by Day — Day 43 — Amazon AthenaExploring AWS !! Day 43: Amazon Athena Serverless, Interactive query Platform, works on data stored in S3.It uses standard SQL for querying dataIt supports variety of formats: CSV, JSON, Avro, ORC (Columnar), Parquet (Columnar)Only pay for querying t...AWS
Amrutha Damruthadronamraju.hashnode.dev·Dec 10, 2023Amazon Athena: Your Serverless Data Analytics Solution1: What is Amazon Athena, and how does it differ from Microsoft SQL Server and MySQL?Amazon Athena is a serverless query service that allows analysis of data stored in Amazon S3 using standard SQL. It differs from Microsoft SQL Server as it's serverl...AWS Services Interview Q/AAWS
