Tag feed

#stream-processing

25 posts1 followers

Explore Hashnode

Alternatives

Trending tags this week

AJAshmit JaiSarita Guptaengineeringwithashmit.hashnode.devJul 28 · 11 min read

From fingerprints to an incident: counting in windows, paging once

A fingerprint names a bug. It does not decide that the bug is worth waking someone for. That decision is the clustering service: it counts each fingerprint inside a five-minute tumbling window keyed o

0

SKSachin Kamathzeliot-official.hashnode.devJul 2 · 24 min read

Kafka Streams: A Production Guide to Joins, Aggregations, and Stateful Processing

TL;DR Building real-time data pipelines is often more complex than it appears at first. A simple stream processing application may start with a few Kafka topics, joins, and aggregations. As data volum

0

AAAbstract Algorithmsabstractalgorithms.hashnode.devJun 18 · 9 min read

High-Level Design: Building a Real-Time Ad Click Aggregator at Scale

TLDR: Scaling an ad click aggregator requires processing massive event streams (billions of clicks per day) with exactly-once delivery guarantees. We achieve this using Kafka-based event ingestion, Ap

0

YSYuhao Surisingwave.comMay 22 · 8 min read

How RisingWave Handles Late-Arriving Data and Watermarks

TL;DR: RisingWave models late-arriving data with a watermark expression declared right in the CREATE TABLE or CREATE SOURCE DDL. The watermark advances as event time progresses, windows close when the

0

RLRisingWave Labsrisingwave.comMay 22 · 8 min read

Stream Processing Without a Message Queue: Do You Really Need Kafka?

TL;DR: Many real-time systems reach for Apache Kafka by default, but a streaming database like RisingWave can ingest directly from Postgres or MySQL via CDC, from S3 files, from synthetic data generat

0

YSYuhao Surisingwave.comMay 22 · 10 min read

Why Your Iceberg Ingestion Pipeline Breaks Under Scale (And How to Fix It)

TL;DR The three most common Iceberg ingestion pipeline failures at scale are small file explosion from frequent checkpoints, commit conflicts from concurrent writers, and compaction debt that steadily

0

FSFahad Shahrisingwave.comApr 8 · 13 min read

Kafka Streams vs RisingWave in 2026: When You Need a Database

What Kafka Streams Is (and Is Not) Kafka Streams is a client library, not a service. That distinction matters more than almost anything else in this comparison. When you use Kafka Streams, you write Java or Kotlin code that imports the Kafka Streams ...

0

FSFahad Shahrisingwave.comApr 8 · 14 min read

Apache Flink Alternatives in 2026: When SQL Is Enough

{ "@context": "https://schema.org", "@type": "FAQPage", "mainEntity": [ { "@type": "Question", "name": "What are the best Apache Flink alternatives in 2026?", "acceptedAnswer": { "@type": "Answer", "text": ...

0

RLRisingWave Labsrisingwave.comApr 7 · 16 min read

Apache Flink vs RisingWave for Real-Time Analytics: Benchmark Results

In the Apache Flink vs RisingWave real-time analytics benchmark using the Nexmark suite, RisingWave outperforms Flink on 22 of 27 queries, often by a factor of 2x to 10x. The largest gains appear on aggregation-heavy queries, where RisingWave's incre...

0

RLRisingWave Labsrisingwave.comApr 2 · 10 min read

Process-Time Temporal Joins in RisingWave: Zero State on the Stream Side

Every e-commerce platform has some version of this pipeline: orders land in a Kafka topic, you enrich each one with product details from a catalog table, and the result feeds a dashboard, a feature store, or a downstream sink. The join looks trivial ...

0

#stream-processing

Search Hashnode

#stream-processing

Explore Hashnode

Trending tags this week

From fingerprints to an incident: counting in windows, paging once

Kafka Streams: A Production Guide to Joins, Aggregations, and Stateful Processing

High-Level Design: Building a Real-Time Ad Click Aggregator at Scale

How RisingWave Handles Late-Arriving Data and Watermarks

Stream Processing Without a Message Queue: Do You Really Need Kafka?

Why Your Iceberg Ingestion Pipeline Breaks Under Scale (And How to Fix It)

Kafka Streams vs RisingWave in 2026: When You Need a Database

Apache Flink Alternatives in 2026: When SQL Is Enough

Apache Flink vs RisingWave for Real-Time Analytics: Benchmark Results

Process-Time Temporal Joins in RisingWave: Zero State on the Stream Side