May 3 · 23 min read · TLDR: SQL partitioning divides one logical table into smaller physical child tables, all accessed through the parent table name. The query optimizer skips irrelevant child tables entirely — a process called partition pruning — turning a 30-second ful...
Join discussionMay 3 · 22 min read · TLDR: Every NoSQL database hides a partitioning engine behind a deceptively simple API. Cassandra uses a consistent hashing ring where a Murmur3 hash of your partition key selects a node — virtual nodes (vnodes) make rebalancing smooth. DynamoDB mana...
Join discussionApr 19 · 16 min read · 🔥 When Your Database Bill Triples Overnight A retail engineering team ships a flash-sale feature. Traffic spikes 10×. Their Azure CosmosDB bill triples within 24 hours. Queries that ran in 5ms now take 800ms. The on-call engineer bumps provisioned R...
Join discussionApr 19 · 24 min read · TLDR: Spark's partition count and partitioning strategy are the two levers that determine whether a job scales linearly or crumbles under data growth. HashPartitioner distributes keys by hash modulo — fast and uniform for well-distributed keys, catas...
Join discussionApr 3 · 5 min read · The right Iceberg partition strategy can reduce query scan costs by 10–100x and prevent the small-file problem that degrades streaming pipeline performance. For streaming data written by RisingWave, partition by event time using Iceberg's hidden part...
Join discussion
Feb 12 · 11 min read · Why Traditional Scaling Approaches Fail at Modern Scale Vertical scaling—adding more CPU, RAM, and faster storage to a single database server—hits hard limits around 96-128 cores and a few terabytes of RAM. Cloud providers offer increasingly powerful...
Join discussionFeb 12 · 10 min read · Why Traditional Partitioning Approaches Fail at Scale The default Kafka partitioner uses a murmur2 hash of the message key modulo the partition count. This works adequately for uniformly distributed keys with similar throughput characteristics. Howev...
Join discussionFeb 12 · 10 min read · Metadata SEO Title: PostgreSQL Partitioning: Range vs List vs Hash Strategies Meta Description: Learn when to use range, list, or hash partitioning in PostgreSQL. Compare strategies with production examples to optimize query performance at scale. Pri...
Join discussionOct 23, 2025 · 6 min read · The basic idea behind database partitioning is to take a very large table and split it into smaller, more manageable pieces, called partitions. However, to your application and your queries, it still looks and acts like a single table. The database m...
Join discussionSep 4, 2025 · 24 min read · For decades, the single relational database instance has been the bedrock of countless applications. It is a powerful, reliable workhorse, offering ACID guarantees, robust querying capabilities, and a mature ecosystem of tools. However, as applicatio...
Join discussion
