Shivanagouda Agasimanishiva02.hashnode.dev·Apr 17, 2024Problems with Replication LagLeader-based replication requires all writes to go through a single node, but read only queries can go to any replica. For workloads that consist of mostly reads and only a small percentage of writes (a common pattern on the web), there is an attrac‐...Discussdistributed system
Aryaman Guptaaryamangupta.hashnode.dev·Apr 14, 2024Demystifying Replication and Sharding in MongoDBMaking a MongoDB cluster "Production Ready" by performing database Replication and Sharding (horizontal fragmentation) What is Replication? Replication is the method of duplication of data across multiple servers. For example, we have an application ...Discussreplication
Sai SrirampurforPeerDB Blogblog.peerdb.io·Apr 11, 2024PeerDB raises $3.6 million seed funding to revolutionize data movement for PostgreSQLPeerDB offers a fast and cost-effective way to move data from PostgreSQL to data warehouses, such as Snowflake, and to queues like Kafka. This enables businesses to have real-time and reliable access to data, which is of utmost importance in this AI ...Discuss·1.8K readsPostgreSQL
Sai SrirampurforPeerDB Blogblog.peerdb.io·Apr 1, 2024Exploring versions of the Postgres logical replication protocolIntroduction Logical Replication is one of the many ways a Postgres database can replicate data to other Postgres database (a.k.a standby). Logical replication directly reads from the write-ahead log (WAL), recording every database change, avoiding t...Discuss·1 like·4.5K readsPostgreSQL
Divya MahajanforPartner Penspartnerpens.hashnode.dev·Mar 21, 2024Amazon S3 Replication: Hands-On | A Step-by-Step GuideStep 1: Navigate to Amazon S3 console Open your web browser and go to the AWS Management Console at https://console.aws.amazon.com/. Sign in to your AWS account using your credentials. Once logged in, locate and click on "S3" under the "Storage" c...DiscussAWS Cloud Hands-On Kit | Step-By-Step Guidesreplication
Sachin Adighatodghach.hashnode.dev·Mar 1, 2024Replication in S3: The technique which makes your data available all the timeRecap and Intro to this blog The previous two blogs in the S3 series expressed some views about what S3 is and some security aspects of S3. If you have not read those two blogs, don't worry. Here are the links: Blog -1: The Simple Storage Service: AW...Discuss·1 likeS3Replication
Kaushik IskaforPeerDB Blogblog.peerdb.io·Feb 21, 2024Moving a Billion Postgres Rows on a $100 BudgetInspired by the 1BR Challenge, I wanted to see how much it would cost to transfer 1 billion rows from Postgres to Snowflake. Moving 1 billion rows is no easy task. The process involves not just the transfer of data but ensuring its integrity, error r...Discuss·5 likes·31.1K readsPostgreSQL
Kaushik IskaforPeerDB Blogblog.peerdb.io·Feb 16, 2024PeerDB UI - Deeper Dive: Part 1At PeerDB, we are building a fast and cost-effective way to replicate data from Postgres to Data Warehouses such as BigQuery, Snowflake and ClickHouse. When building PeerDB UI, we wanted it to be minimal but effective. Features were driven by what th...Discuss·206 readsPostgreSQL
Sai SrirampurforPeerDB Blogblog.peerdb.io·Feb 14, 2024Postgres to ClickHouse Real time Replication using PeerDBToday we at PeerDB are introducing the ClickHouse target connector in Beta. With this you can seamlessly replicate data in Postgres to ClickHouse with low latency and high throughput. ClickHouse was one of the most asked connector from our customers,...Discuss·4.5K readsPostgreSQL
Amogh BharadwajforPeerDB Blogblog.peerdb.io·Jan 26, 2024Data Types Need Care during Database ReplicationMoving data from one data store to another means finding common ground. Data stores speak in terms of data types. Two data stores will never have a perfect overlap when it comes to what data types they support. It's the responsibility of a data movem...Discuss·420 readsPostgreSQL