Tag feed

#cdc

64 posts1 followers

Explore Hashnode

Alternatives

Trending tags this week

SSapotaCorpsapotacorpvn.hashnode.devJul 12 · 7 min read

CDC into a lakehouse: Change Data Feed, MERGE, and not reprocessing everything

Most pipelines start append-only, and for a while that is fine. Data arrives, you add it to the table, life is simple. Then the source starts sending updates to records you already have, and deletes f

0

VAVictor Alekseevkrocodl.hashnode.devJul 3 · 61 min read

Database synchronization based on Invertible Bloom Filters

The problem: synchronize state between two tables, a source and a destination. Most approaches depend on specific database server capabilities or on the structure of the source table. In 2011, Michael

0

NENguyen Engineernguyengineer.devJun 30 · 14 min read

How I built and scaled real‑time chat app from 2 to millions of users — without a rewrite?

Real-time is one of those features that demos in an afternoon and humbles you for a month. Open a WebSocket, push a message, watch it appear on the other screen — done, right? That's the part that's e

5

SJM

RLRisingWave Labsrisingwave.comMay 22 · 8 min read

Stream Processing Without a Message Queue: Do You Really Need Kafka?

TL;DR: Many real-time systems reach for Apache Kafka by default, but a streaming database like RisingWave can ingest directly from Postgres or MySQL via CDC, from S3 files, from synthetic data generat

0

RLRisingWave Labsrisingwave.comMay 22 · 9 min read

CDC to Iceberg: Sync Your Operational Database to the Data Lake in Real Time

CDC to Iceberg is a common data engineering challenge: you need the latest changes from your operational database replicated to your data lake in minutes, not hours. RisingWave solves this with a sing

0

AAAbstract Algorithmsabstractalgorithms.hashnode.devApr 17 · 49 min read

Change Feed vs Change Stream: CDC Internals, Reliability, and When to Avoid Each

In the summer of 2023, the platform team at a fast-growing e-commerce company was handling 100,000 orders per day across three microservices: Order Service, Inventory Service, and Billing Service. All

0

FSFahad Shahrisingwave.comApr 8 · 16 min read

Best CDC Tools for Real-Time Analytics in 2026

{ "@context": "https://schema.org", "@type": "FAQPage", "mainEntity": [ { "@type": "Question", "name": "What is the best CDC tool for real-time analytics in 2026?", "acceptedAnswer": { "@type": "Answer", "t...

0

FSFahad Shahrisingwave.comApr 7 · 14 min read

Agentic Data Architecture: A SQL-First Implementation Guide

Introduction Search for "agentic data architecture" and you will find no shortage of material. Pyramid diagrams with three to five layers. Circles labeled "orchestration" pointing to other circles labeled "context." Frameworks with names like the Rea...

0

FSFahad Shahrisingwave.comApr 7 · 12 min read

Build a Continuous RAG Pipeline with Streaming SQL

Introduction You spent three weeks building a RAG pipeline. The embeddings are clean. The retrieval scores look good. The demo works perfectly. Then it goes to production, and a week later the support team starts forwarding user complaints: the assis...

0

FSFahad Shahrisingwave.comApr 7 · 11 min read

How to Build a Real-Time Context Engine for AI Agents

{ "@context": "https://schema.org", "@type": "FAQPage", "mainEntity": [ { "@type": "Question", "name": "What is a context engine for AI agents?", "acceptedAnswer": { "@type": "Answer", "text": "A context en...

0

#cdc

Search Hashnode

#cdc

Explore Hashnode

Trending tags this week

CDC into a lakehouse: Change Data Feed, MERGE, and not reprocessing everything

Database synchronization based on Invertible Bloom Filters

How I built and scaled real‑time chat app from 2 to millions of users — without a rewrite?

Stream Processing Without a Message Queue: Do You Really Need Kafka?

CDC to Iceberg: Sync Your Operational Database to the Data Lake in Real Time

Change Feed vs Change Stream: CDC Internals, Reliability, and When to Avoid Each

Best CDC Tools for Real-Time Analytics in 2026

Agentic Data Architecture: A SQL-First Implementation Guide

Build a Continuous RAG Pipeline with Streaming SQL

How to Build a Real-Time Context Engine for AI Agents