Jan 20 · 7 min read · You're building something. Maybe it's a web app. Maybe it's an analytics dashboard. Maybe it's just a service that needs to log some events. And then someone on your team says, "we should use Kinesis for this." And you're like... what? Why? We alread...
Join discussion
Apr 27, 2025 · 3 min read · Recently, I was working on a new project — a clone of the company’s original product — and was assigned a ticket regarding an email sending issue on a high-priority feature. While working on the ticket, I came across the AWS service Kinesis. I added ...
Join discussion
Nov 14, 2024 · 7 min read · In today's fast-paced digital world, understanding and using real-time data replication is crucial. It helps you seamlessly integrate and transform data across different systems. As data-driven strategies gain momentum, businesses are increasingly ...
Join discussion
Oct 20, 2024 · 7 min read · 🤔 Ever wondered why real-time data security is such a big deal? As our digital world grows, keeping data pipelines secure is key. It stops sensitive info from falling into the wrong hands. Importance of Secure Real-Time Data Pipelines Building a sec...
Join discussion
Aug 4, 2024 · 4 min read · Hi there 👋, I'm Tanishka Marrott Today, I'll be taking you through an exciting journey where we've seamlessly integrated the primary phases of data ingestion, processing, storage, and visualization into a single cohesive pipeline using AWS services ...
Join discussion
Jun 24, 2024 · 6 min read · In the world of real-time data processing, Amazon Kinesis and Apache Kafka are popular tools for handling large streams of data. Processing this data can be done using various frameworks and libraries, among which Python consumers and Apache Spark St...
Join discussion
Apr 14, 2024 · 2 min read · Before you run this script: Install Boto3 using pip if you haven't already: pip install boto3. Configure your AWS credentials properly. You can either set them up using the AWS CLI (aws configure) or set environment variables (AWS_ACCESS_KEY_ID and...
Join discussion
Feb 13, 2024 · 11 min read · The adoption of event driven architecture became a real challenge of many enterprises since some years and lately raised this adoption bar. The companies achieve the principal pillars of a well architected system by relying on decoupled and asynchron...
Join discussion
Dec 16, 2023 · 26 min read · 🎯 Importance of Data Analysis The significance of data analysis in business has grown substantially, offering organizations valuable insights to enhance decision-making. Amazon's suite of data analysis tools presents a robust solution for collecting...
Join discussion
Nov 24, 2023 · 3 min read · Fan-out and Fan-in refer to breaking a task into subtasks, executing multiple functions concurrently, and then aggregating the result. They’re two patterns that are used together. The Fan-out pattern messages are delivered to workers, each receiving ...
Join discussion