Mar 5 · 14 min read · In modern lakehouse architectures, data lives in object storage, tables use open formats like Apache Iceberg, and multiple compute engines query the same datasets. Even with storage, format, and engin
Join discussion
Feb 5 · 9 min read · Modern digital products live and die by user behavior signals. Every page view, click, add-to-cart, and purchase carries immediate business value, but only if it’s processed while it still matters. Teams increasingly need: Live traffic visibility, s...
Join discussion
Feb 5 · 9 min read · Introduction Iceberg makes the lakehouse look pleasantly “clean”: the table format is open, the data lives in object storage, and in principle you can swap query engines without paying a huge migration tax or getting locked into a vendor. The catch i...
Join discussion
Jan 9 · 4 min read · RisingWave is built as a streaming-first system, designed to react to changes as they happen. However, not all real-world data behaves like a stream. Many external batch data sources—such as snapshot-based tables—do not emit change events at all. Eve...
Join discussion
Dec 5, 2025 · 6 min read · Apache Iceberg has become the de facto standard for open table formats by providing ACID transactions, time travel, and schema evolution. However, the very mechanics that enable these features, specifically snapshots and distinct delete files, introd...
Join discussion
Oct 29, 2025 · 8 min read · In the era of big data, data lakes became a popular choice for large-scale analytics, thanks to their flexibility, low cost, and separation of storage and compute. But they’ve also struggled with consistency, schema drift, and complex query optimizat...
Join discussion
Oct 20, 2025 · 3 min read · ( AI, Data, NiFi, Iceberg, Polaris, Streamlit, Flink, Kafka, Python, Java, SQL, MCP, LLM, RAG, Cortex AI, AISQL, Search, Unstructured Data ) #212: 20 Oct 2025 https://bsky.app/profile/paasdev.bsky.social NiFi + AI + AI Data Cloud + Iceberg. https://...
Join discussion
Oct 17, 2025 · 5 min read · Every data engineer knows the struggle: optimizing for high-throughput data ingestion often means sacrificing query performance. Do you tune your system for absorbing massive volumes of real-time events, or for powering snappy, responsive dashboards?...
Join discussion
Oct 15, 2025 · 9 min read · One-line deployment with REST catalog, automatic compaction, and an integrated ingestion engine, fully compatible with all query engines. Finally, you can run Iceberg just like Postgres. Why We Built This We started adopting Apache Iceberg internally...
Join discussion
Oct 11, 2025 · 11 min read · Table-format idea flow: Iceberg (batch snapshots) → Hudi (incremental COW/MOR) → Delta Lake (txn log & deletion vectors) → Paimon (stream-native LSM) → DuckLake (catalog-first). From Snapshots to Synapses Over the last few years, “table formats” quie...
Join discussion