ASAnshul Shuklainanshulshukla.com·Oct 19, 2023 · 2 min readPartitioning, Sharding & ReplicationUse Case: Online Shopping Website Imagine you are running a popular online shopping website that sells various products. Your website has a vast amount of data, including product details, customer information, and order history. 1. Partitioning: Scen...00
ASAnshul Shuklainanshulshukla.com·Oct 19, 2023 · 2 min readConsistent Hashing - in simple wordsImagine you're running a big website, and lots of people are visiting it every day. To handle this traffic, you have multiple servers. Now, you want to distribute the load of incoming requests among these servers efficiently. Consistent hashing is a ...00
ASAnshul Shuklainanshulshukla.com·Oct 19, 2023 · 1 min readDatabaseA lot of buzz world - ETL (Extract, transform, load), OLTP, OLAP, Data Warehouse and many more. What exactly they are and why I should care? https://www.youtube.com/watch?v=oF_2uDb7DvQ00
ASAnshul Shuklainanshulshukla.com·Aug 11, 2023 · 3 min readStream Processing FrameworksThese frameworks are commonly used for processing and analyzing streaming data. Let's briefly explore each one: ksql: ksql is a streaming SQL engine for Apache Kafka. It provides a higher-level abstraction for processing and analyzing data streams u...00
ASAnshul Shuklainanshulshukla.com·Apr 27, 2023 · 3 min readOutbox and CDC (Change Data Capture)Outbox and CDC (Change Data Capture) are both techniques used in data integration and data synchronization. Outbox is a pattern used to handle data consistency in distributed systems. It involves maintaining a separate table or collection to keep tra...00
