Alex Mercedalexmerced.hashnode.dev·Oct 22, 2024All About Parquet Part 10 - Performance Tuning and Best Practices with ParquetFree Copy of Apache Iceberg the Definitive Guide Free Apache Iceberg Crash Course Iceberg Lakehouse Engineering Video Playlist Throughout this series, we’ve explored the many features that make Apache Parquet a powerful and efficient file format for...Apache Parquet
Alex Mercedalexmerced.hashnode.dev·Oct 22, 2024All About Parquet Part 07 - Metadata in Parquet | Improving Data EfficiencyFree Copy of Apache Iceberg the Definitive Guide Free Apache Iceberg Crash Course Iceberg Lakehouse Engineering Video Playlist In the previous posts, we’ve covered how Parquet optimizes storage through columnar storage, compression, and encoding. No...Apache Parquet
Alex Mercedalexmerced.hashnode.dev·Oct 22, 2024All About Parquet Part 06 - Encoding in Parquet | Optimizing for StorageFree Copy of Apache Iceberg the Definitive Guide Free Apache Iceberg Crash Course Iceberg Lakehouse Engineering Video Playlist In the last blog, we explored the various compression techniques supported by Parquet to reduce file size and improve quer...Apache Parquet
Alex Mercedalexmerced.hashnode.dev·Oct 22, 2024All About Parquet Part 05 - Compression Techniques in ParquetFree Copy of Apache Iceberg the Definitive Guide Free Apache Iceberg Crash Course Iceberg Lakehouse Engineering Video Playlist One of the key benefits of using the Parquet file format is its ability to compress data efficiently, reducing storage cos...Apache Parquet
Alex Mercedalexmerced.hashnode.dev·Oct 22, 2024All About Parquet Part 04 - Schema Evolution in ParquetFree Copy of Apache Iceberg the Definitive Guide Free Apache Iceberg Crash Course Iceberg Lakehouse Engineering Video Playlist When working with large datasets, schema changes—whether it’s adding new fields, modifying data types, or removing column...Apache Parquet
Alex Mercedalexmerced.hashnode.dev·Oct 22, 2024All About Parquet Part 03 - Parquet File Structure | Pages, Row Groups, and ColumnsFree Copy of Apache Iceberg the Definitive Guide Free Apache Iceberg Crash Course Iceberg Lakehouse Engineering Video Playlist In the previous post, we explored the benefits of Parquet’s columnar storage model. Now, let’s delve deeper into the inter...Apache Parquet
Alex Mercedalexmerced.hashnode.dev·Oct 22, 2024All About Parquet Part 02 - Parquet's Columnar Storage ModelFree Copy of Apache Iceberg the Definitive Guide Free Apache Iceberg Crash Course Iceberg Lakehouse Engineering Video Playlist In the first post of this series, we introduced the Apache Parquet file format and touched upon one of its key features—co...Apache Parquet
Alex Mercedalexmerced.hashnode.dev·Oct 22, 2024All About Parquet Part 01 - An IntroductionFree Copy of Apache Iceberg the Definitive Guide Free Apache Iceberg Crash Course Iceberg Lakehouse Engineering Video Playlist Managing and processing large datasets efficiently is crucial for many organizations. One of the key factors in data effic...Apache Parquet