10h ago · 5 min read · The right Iceberg partition strategy can reduce query scan costs by 10–100x and prevent the small-file problem that degrades streaming pipeline performance. For streaming data written by RisingWave, partition by event time using Iceberg's hidden part...
Join discussion
Feb 12 · 11 min read · Why Traditional Scaling Approaches Fail at Modern Scale Vertical scaling—adding more CPU, RAM, and faster storage to a single database server—hits hard limits around 96-128 cores and a few terabytes of RAM. Cloud providers offer increasingly powerful...
Join discussionFeb 12 · 10 min read · Why Traditional Partitioning Approaches Fail at Scale The default Kafka partitioner uses a murmur2 hash of the message key modulo the partition count. This works adequately for uniformly distributed keys with similar throughput characteristics. Howev...
Join discussionFeb 12 · 10 min read · Metadata SEO Title: PostgreSQL Partitioning: Range vs List vs Hash Strategies Meta Description: Learn when to use range, list, or hash partitioning in PostgreSQL. Compare strategies with production examples to optimize query performance at scale. Pri...
Join discussionOct 23, 2025 · 6 min read · The basic idea behind database partitioning is to take a very large table and split it into smaller, more manageable pieces, called partitions. However, to your application and your queries, it still looks and acts like a single table. The database m...
Join discussionSep 4, 2025 · 24 min read · For decades, the single relational database instance has been the bedrock of countless applications. It is a powerful, reliable workhorse, offering ACID guarantees, robust querying capabilities, and a mature ecosystem of tools. However, as applicatio...
Join discussionAug 29, 2025 · 3 min read · Kubernetes uses StatefulSets to manage pods that need persistent identity and storage, such as databases and clustered apps. When working with StatefulSets, understanding how pods are created, deleted, and updated is key for reliable deployments. Ord...
Join discussion
Jul 2, 2025 · 22 min read · Database Sharding Strategies and Implementation: A Deep Dive for Senior Engineers The Unyielding Pressure of Scale: When Your Database Becomes the Bottleneck Imagine a rapidly growing e-commerce platform, processing millions of transactions daily. Or...
Join discussionJun 25, 2025 · 13 min read · Recap: Where We Stand Till now in this series, we established a secure, governed AWS data mesh platform, onboarded a real-world dataset, and enabled both publishers and consumers to collaborate seamlessly using S3, Glue, Lake Formation, and Athena. O...
Join discussion
Apr 20, 2024 · 4 min read · In the realm of distributed systems and databases, partitioning and sharding are two terms that often come up when discussing scalability and performance. While they share similarities, they serve distinct purposes and are implemented differently. Th...
Join discussion
