Feb 12 · 13 min read · Apache Flink vs Kafka Streams: Choosing the Right Stream Processing Framework Modern applications generate continuous streams of data—user interactions, IoT sensor readings, financial transactions, and system logs—that require immediate processing an...
Join discussionJan 19 · 5 min read · ( AI, Data, NiFi, Iceberg, Polaris, Streamlit, Flink, Kafka, Python, Java, SQL, MCP, LLM, RAG, Cortex AI, AISQL, Search, Unstructured Data ) https://thekingcenter.org/ Sorry for missing the Flink talk on Thursday, there was a death in my family. ❄️ T...
Join discussion
Jan 11 · 2 min read · In senior system design interviews, even very experienced managers and architects often demonstrate strong familiarity with streaming tools—yet limited clarity when the discussion shifts to trade-offs, failure handling, and selecting the right stream...
Join discussionDec 8, 2025 · 10 min read · The Speed Layer is like a team of couriers, rushing fresh orders from Kafka to the database. But moving fast doesn’t mean everything is fine. The Courier’s Worst Nightmare: The Pile-Up Picture yourself as a logistics dispatcher. At first, everything ...
Join discussion
Sep 15, 2025 · 20 min read · The relentless march towards real-time data processing has fundamentally reshaped enterprise architecture. Gone are the days when batch processing, with its inherent latency, could satisfy all business needs. Today, organizations demand instant insig...
Join discussionAug 25, 2025 · 23 min read · Apache Flink, Apache Kafka, and RisingWave have emerged as the top stream processing frameworks for 2025. Kafka, adopted by over 150,000 organizations, provides a powerful backbone for streaming data pipelines. Flink delivers ultra-low-latency stream...
Join discussion
Jul 22, 2025 · 7 min read · Overview This page provides a step-by-step guide to setting up and running a Change Data Capture (CDC) pipeline using Flink CDC to capture changes in a PostgreSQL database and replicate them to another PostgreSQL database. Prerequisites PostgreSQL:...
Join discussion
Jun 9, 2025 · 3 min read · Design Real-time analytics is at the heart of many modern applications — from fraud detection to personalized dashboards. In this guide, we'll walk through how to build a real-time analytics pipeline using: 🔧 Java 21 📬 Apache Kafka 🔁 Apache Fli...
Join discussionJun 3, 2025 · 3 min read · How fast is fast enough? If you’ve worked with data systems or even read about them, you’ve probably come across the terms real-time and near real-time. They sound similar and they’re often used interchangeably, but the difference between them actual...
Join discussionMay 21, 2025 · 7 min read · Remember when 'big data' just meant patiently waiting for yesterday's sales figures to show up on your desk? Ah, the good old days of batch processing! With the advent of real-time data, data processing architectures also evolved. Our apps are real-t...
Join discussion