Partitioning, Sharding & ReplicationUse Case: Online Shopping Website Imagine you are running a popular online shopping website that sells various products. Your website has a vast amount of data, including product details, customer information, and order history. 1. Partitioning: Scen...Oct 19, 2023 · 2 min readanshulshukla.com
Consistent Hashing - in simple wordsImagine you're running a big website, and lots of people are visiting it every day. To handle this traffic, you have multiple servers. Now, you want to distribute the load of incoming requests among these servers efficiently. Consistent hashing is a ...Oct 19, 2023 · 2 min readanshulshukla.com
DatabaseA lot of buzz world - ETL (Extract, transform, load), OLTP, OLAP, Data Warehouse and many more. What exactly they are and why I should care? https://www.youtube.com/watch?v=oF_2uDb7DvQOct 19, 2023 · 1 min readanshulshukla.com
Stream Processing FrameworksThese frameworks are commonly used for processing and analyzing streaming data. Let's briefly explore each one: ksql: ksql is a streaming SQL engine for Apache Kafka. It provides a higher-level abstraction for processing and analyzing data streams u...Aug 11, 2023 · 3 min readanshulshukla.com
Outbox and CDC (Change Data Capture)Outbox and CDC (Change Data Capture) are both techniques used in data integration and data synchronization. Outbox is a pattern used to handle data consistency in distributed systems. It involves maintaining a separate table or collection to keep tra...Apr 27, 2023 · 3 min readanshulshukla.com