Kaushik IskaforPeerDB Blogblog.peerdb.io·Feb 16, 2024PeerDB UI - Deeper Dive: Part 1At PeerDB, we are building a fast and cost-effective way to replicate data from Postgres to Data Warehouses such as BigQuery, Snowflake and ClickHouse. When building PeerDB UI, we wanted it to be minimal but effective. Features were driven by what th...Discuss·208 readsPostgreSQL
Gireesh Kapilablog.thedevperspective.com·Dec 18, 2023Transactional Outbox PatternIn distributed systems, maintaining data consistency and ensuring reliable message delivery can be challenging. The transactional outbox pattern is a robust solution to address these concerns, particularly in microservice architectures. The Challenge...Discussoutbox
Tao Chenbabyfish-ct.hashnode.dev·Sep 22, 2023High-quality documentation for my ORM framework(Java & Kotlin) is completedThe high-quality documentation for my ORM framework is now complete: Jimmer, revolutionary ORM for java & kotlin Based on suggestions from a group of Jimmer users, I spent a full four months writing this high-quality documentation. In the past, I’ve ...Discuss·1 like·49 readsJava
ByteHousebytehouse.hashnode.dev·Sep 21, 20237 advantages of using log-based CDC vs other methodsChange Data Capture (CDC) is a technique used to track and capture changes made to data in a database. The primary goal of CDC is to identify and extract only the changed data from the source database, rather than extracting and processing the entire...Discusschange data capture
Chris BathProblog.bluurr.com·Sep 9, 2023Microservices - Help my data is stuck in the monolithI'm always hearing of organisations that are looking to embark on the journey of decomposing their monolith into microservices. This post explores near real-time data migration challenges from monolithic to microservices architecture. Several strateg...Discuss·218 readsarchitecture
ByteHousebytehouse.hashnode.dev·Sep 6, 20237 reasons why a user would need to query Amazon S3 directlyAmazon S3 (Simple Storage Service) is a highly scalable and durable object storage service provided by Amazon Web Services (AWS). It is commonly used to store and retrieve large amounts of data, such as images, videos, log files, backups, and other u...DiscussAmazon S3
Matías Navarro-Carterblog.mnavarro.dev·Aug 3, 2023A CRUD RealityThe Nasty U in CRUD Before anything else, let's just do a quick recap on what CRUD is. CRUD stands for "Create-Read-Update-Delete" which are, in turn, the four basic operations of data storage. It's usually used as an adjective to describe a system. ...Discuss·2.3K readsPHP
tomiwatomiwa.hashnode.dev·Aug 2, 2023Leveraging CDC for Efficient Data Ingestion in Apache KafkaIntroduction Apache Kafka has emerged as a leading platform for data streaming and processing, allowing organizations to harness real-time data for critical insights and decision-making. However, the success of Kafka heavily relies on the efficient a...Discuss·34 readskafka
Itay Braunpostgres.hashnode.dev·Jul 31, 2023PeerDB wants to help you quickly export data from PostgreSQLThere are many great ETL tools, such as airbyte. PeerDB is a new ETL tool, dedicated to PostgreSQL only. The ETL engine uses built-in Change Data Capture (CDC) to detect changes and forward them to your destination. Here you can see the supported con...Discusspg tools
Anshul Shuklaanshulshukla.com·Apr 27, 2023Outbox and CDC (Change Data Capture)Outbox and CDC (Change Data Capture) are both techniques used in data integration and data synchronization. Outbox is a pattern used to handle data consistency in distributed systems. It involves maintaining a separate table or collection to keep tra...Discuss·372 readsoutbox
