@akshay-habbu
Data Engineering and more
Nothing here yet.
Nothing here yet.
May 3, 2022 · 2 min read · Designing Data-Intensive Applications [Book Highlights] [ Part II : Chapter V ] Distributed Data Leaderless Replication in a leaderless configuration, failover does not exist the client sends the write to all three replicas in parallel, and the two ...
Join discussionMay 2, 2022 · 2 min read · Designing Data-Intensive Applications [Book Highlights] [ Part II : Chapter V ] Distributed Data Multi-Leader Replication Multi-datacenter operation - we have a database with replicas in several different datacenters. With a normal leader-based repl...
Join discussionApr 30, 2022 · 2 min read · Designing Data-Intensive Applications [Book Highlights] [ Part II : Chapter V ] Distributed Data Implementation of Replication Logs Statement-based replication In the simplest case, the leader logs every write request (statement) that it executes an...
Join discussionApr 27, 2022 · 2 min read · Designing Data-Intensive Applications [Book Highlights] [Part I : Chapter IV] Encoding and Evolution Avro To maintain forward and backward compatibility its important to add or remove a field that has some default value. In case of Avro, You can onl...
Join discussionApr 25, 2022 · 3 min read · Spark Structured Streaming Dynamic Dataset Join I have came across a unique problem, I had a list of valid names in some remote configuration which changes often. Now I have a spark structured streaming job which runs always and it is an always on ki...
Join discussion