Gireesh Kapilablog.thedevperspective.com·Dec 18, 2023Transactional Outbox PatternIn distributed systems, maintaining data consistency and ensuring reliable message delivery can be challenging. The transactional outbox pattern is a robust solution to address these concerns, particularly in microservice architectures. The Challenge...Discussoutbox
Basanta Kharelbasantakharel.com·May 9, 2023Setting up Kafka Connect with Debezium Connectors: Importance of Database History ParametersIf you're working with databases, you've probably heard of Kafka, Kafka Connect, and connectors. In a nutshell, Kafka is a distributed streaming platform that allows you to publish and subscribe to streams of records, while Kafka Connect is a framewo...Discuss·1.6K readskafka connect
Basanta Kharelbasantakharel.com·Apr 6, 2023Building a Scalable Streaming Architecture with Kafka and Debezium for Multiple SQL DatabasesIn a recent project at work, we needed to monitor changes to data stored in multiple databases and services in real-time. To achieve this goal, we opted for Kafka as our distributed streaming platform. We chose Confluent Cloud, the hosted service pro...Discuss·1 like·521 readskafka connect
Harsh Gajjarspringworld.hashnode.dev·Mar 17, 2023How to Set Up Debezium with MySQL for Real-Time Data Streaming and Change Data CaptureHow to Set Up Debezium with MySQL for Real-Time Data Streaming and Change Data Capture Debezium is a powerful open-source platform for change data capture (CDC) that can be used to stream and process data changes from various database management syst...Discuss·113 readsdebezium
Joseph Ganbwgjoseph.com·Mar 12, 2023Spring Boot Debezium (embedded) Engine with MongoDB as Source - Part 1I am exploring to use Debezium as my Change Data Capture tool to introduce it into my team/project. I wanted to keep it simple, hence I chose to go with the embedded engine. I wasn't able to find many examples of using MongoDB as a source database (e...Discuss·1.6K readsdebezium
Marcos Arujmarcs.hashnode.dev·Feb 10, 2023Easing Monolith decomposition with Kafka Connect, Debezium and KsqlDB.In recent years, microservices architecture has become increasingly popular as organizations look to break down their monolithic applications into smaller, more manageable pieces. This can bring many benefits, such as increased agility and scalabilit...Discuss·77 readsdebezium
Neenad Ingoleiamninad.hashnode.dev·Feb 4, 2023Docker Compose For Your Next Debezium and Postgres ProjectThis is an addition to my docker-compose setup that allows me to test applications locally and quickly. I like running the services that I am building on my Mac because then it is easy to try any scenarios or replicate the reported bugs also, I think...Discuss·1 like·200 readsDocker Compose Stacksdebezium
Lokesh Sanapalliblog.lokesh1729.com·Jan 28, 2023Change Data Capture Using DebeziumIntroduction What is change data capture? A change that occurred in one data source will be captured and replicated in another data source. Let's understand it with a picture. A: Databases maintain transactional log where it writes all DDL & DML que...Discuss·126 readsdebezium
Jhonatas Kleinkauffjhonatask.hashnode.dev·Jul 26, 2022Kubernetes, debezium and KafkaIn this article i want to show how easy it is to deploy a kafka cluster on kubernetes how to deploy kafka connect with debezium connector streaming postgres events to kafka For the Kafka deployment, I going to be using Strimzi. Strimzi is a helm c...Discuss·2.0K readskafka