Optimizing Iceberg Compaction: Why We Built an Embedded Engine in Rust

Apache Iceberg has become the de facto standard for open table formats by providing ACID transactions, time travel, and schema evolution. However, the very mechanics that enable these features, specifically snapshots and distinct delete files, introd...