Partitioning, Sharding & ReplicationUse Case: Online Shopping Website Imagine you are running a popular online shopping website that sells various products. Your website has a vast amount of data, including product details, customer information, and order history. 1. Partitioning: Scen...2 min read·anshulshukla.comOct 19, 2023
Consistent Hashing - in simple wordsImagine you're running a big website, and lots of people are visiting it every day. To handle this traffic, you have multiple servers. Now, you want to distribute the load of incoming requests among these servers efficiently. Consistent hashing is a ...2 min read·anshulshukla.comOct 19, 2023
DatabaseA lot of buzz world - ETL (Extract, transform, load), OLTP, OLAP, Data Warehouse and many more. What exactly they are and why I should care? https://www.youtube.com/watch?v=oF_2uDb7DvQ1 min read·anshulshukla.comOct 19, 2023
Stream Processing FrameworksThese frameworks are commonly used for processing and analyzing streaming data. Let's briefly explore each one: ksql: ksql is a streaming SQL engine for Apache Kafka. It provides a higher-level abstraction for processing and analyzing data streams u...3 min read·anshulshukla.comAug 11, 2023
Outbox and CDC (Change Data Capture)Outbox and CDC (Change Data Capture) are both techniques used in data integration and data synchronization. Outbox is a pattern used to handle data consistency in distributed systems. It involves maintaining a separate table or collection to keep tra...3 min read·anshulshukla.comApr 27, 2023