SHASHIDHARA G Kstreamliocasestudy.hashnode.dev·Feb 6, 2025Stream LioIntroduction to Real-Time Data Processing 1.1 Understanding Real-Time Data Processing Real-time data processing refers to the ability to continuously ingest, process, and analyze data as it is generated. Unlike traditional batch processing, where dat...streamlio
Yingjun WuforRisingWave Labs Blogrisingwave.com·Jan 24, 2025Stream Processing Systems in 2025: RisingWave, Flink, Spark Streaming, and What's AheadStream processing isn’t a new technology. In fact, the concept has been studied for at least 23 years! The first academic paper I came across dates back to 2002, just two years before the publication of the famous MapReduce paper. Pioneering compani...Blogstreamprocessing
Sarah Akinbamiangeltemmy.hashnode.dev·Jan 8, 2025Introduction to Apache KafkaApache Kafka is a distributed event streaming platform capable of handling trillions of events daily. It is widely used for building real-time data pipelines and streaming applications. In this blog, we will explore Kafka’s architecture, core concept...kafka
Community ContributionforRisingWave Labs Blogrisingwave.com·Jan 3, 2025Top 5 Benefits of Materialized Views for Real-Time AnalyticsIn the fast-paced world of data-driven decision making, the ability to process and analyze vast amounts of information in real time has become a critical competitive advantage. As businesses strive to extract valuable insights from ever-growing data ...Data Engineering 101real time analytics
Heng MaforRisingWave Labs Blogrisingwave.com·Dec 28, 2024Analyzing Live Market Data with Databento and RisingWaveWondering how to build a real-time market analysis pipeline? In this tutorial, we'll combine Databento's market data streams with RisingWave's stream processing capabilities to create a live market analysis system. Why This Matters Real-time market a...Blogreal-time data
Rayees PashaforRisingWave Labs Blogrisingwave.com·Sep 17, 2024Streaming-First Approach to Deliver Unified Data Processing for AllThis blog post continues our series of thought leadership pieces that provide insights into the product strategy and evolution for RisingWave (see the first installment here). In this installment, I would like to explain the rationale behind the need...Blogunified-data-platform
Akhil Kondapaneniakhil-kondapaneni.hashnode.dev·Jul 24, 2024A Beginner's Guide to Real-Time Data Processing with Apache FlinkIntroduction Apache Flink is a distributed processing engine and framework designed for stateful computations on both unbounded and bounded data streams. It is built to operate in all typical cluster environments, delivering in-memory speed and scala...apache-flink
arnab paularnab1656.hashnode.dev·Jun 26, 2024The Kafka Journey🚀 My Journey into the World of Kafka! 🚀 I am excited to share my recent deep dive into the world of Apache Kafka! 🎉 Kafka, a powerful distributed event streaming platform, is reshaping the way we handle real-time data. Here's a quick overview of w...Apache Kafka
Mohamed Mahgoubgoba.hashnode.dev·Jun 22, 2024OOP Vs FPIn the third chapter of the SICP book titled "Modularity, Objects, and State," the book begins by explaining how to structure a system to be modular. It states that there are two ways to achieve this: Object-oriented approach Stream Processing appr...oop
Binyamin Yawitzblog.binyamin.dev·Apr 14, 2024Vector vs BenthosIn this article, we will contrast two stream-processing platforms: Vector - by Datadog versus Benthos - by Ashely. TL;DRGenerally, Benthos is better suited for event processing, whereas Vector is more geared towards metrics and log aggregation. Howev...180 readsvector.dev