---
title: "#parquet articles | Hashnode"
description: "Explore 34 articles tagged #parquet on Hashnode. Tutorials, guides, and how-tos from the community."
url: "https://hashnode.com/tag/parquet"
---

Tag

# #parquet

34 posts · 5 followers

[RowCove](https://hashnode.com/@rowcove) · [Nov 3](https://hashnode.com/posts/check-schema-drift-jsonl-parquet-arrow-shards/6ae9ed788612ae889fe22db8)

### [A clean first shard does not validate a training dataset](https://rowcove.hashnode.dev/check-schema-drift-jsonl-parquet-arrow-shards?utm_source=hashnode&utm_medium=feed)

Check later training-data shards for changed ID types and missing fields. Runnable mock Python checks distinguish file schemas from record validation.

8 min read · [rowcove.hashnode.dev](https://rowcove.hashnode.dev/check-schema-drift-jsonl-parquet-arrow-shards?utm_source=hashnode&utm_medium=feed)

[RowCove](https://hashnode.com/@rowcove) · [Nov 1](https://hashnode.com/posts/find-record-jsonl-parquet-arrow-shards/6ae7443fb42f3c83b125ba07)

### [Finding one bad record in a large dataset: JSONL, Parquet and Arrow](https://rowcove.hashnode.dev/find-record-jsonl-parquet-arrow-shards?utm_source=hashnode&utm_medium=feed)

Trace a record to its source shard, inspect complete values and verify a safe correction—without unnecessary conversions.

8 min read · [rowcove.hashnode.dev](https://rowcove.hashnode.dev/find-record-jsonl-parquet-arrow-shards?utm_source=hashnode&utm_medium=feed)

[RowCove](https://hashnode.com/@rowcove) · [Nov 1](https://hashnode.com/posts/inspect-parquet-without-full-arrow-cache/6ae75c0885e179aee6476a01)

### [Inspect Parquet shards without building a full Arrow dataset cache](https://rowcove.hashnode.dev/inspect-parquet-without-full-arrow-cache?utm_source=hashnode&utm_medium=feed)

Inspect Parquet and Arrow shards with typed IDs, bounded batches and source locations. Runnable mock checks explain preparation and cache tradeoffs.

8 min read · [rowcove.hashnode.dev](https://rowcove.hashnode.dev/inspect-parquet-without-full-arrow-cache?utm_source=hashnode&utm_medium=feed)

[Abstract Algorithms](https://hashnode.com/@abstractalgorithms) · [Apr 19](https://hashnode.com/posts/spark-reading-writing-data-parquet-delta-json/69e437cc90c8f3c452e31feb)

### [Reading and Writing Data in Spark: Parquet, Delta, JSON, and JDBC](https://abstractalgorithms.hashnode.dev/spark-reading-writing-data-parquet-delta-json?utm_source=hashnode&utm_medium=feed)

The format you choose for Spark I/O determines whether predicate pushdown saves you 90% of a scan or reads every byte

34 min read · [abstractalgorithms.hashnode.dev](https://abstractalgorithms.hashnode.dev/spark-reading-writing-data-parquet-delta-json?utm_source=hashnode&utm_medium=feed)

[Firman Fakhri](https://hashnode.com/@firmanfakhri) · [Feb 3](https://hashnode.com/posts/struggling-with-large-csv-files-heres-why-duckdb-changed-my-workflow/69816aadb6f021a562e165fb)

### [Struggling with Large CSV Files? Here's Why DuckDB Changed My Workflow](https://datasquad.hashnode.dev/struggling-with-large-csv-files-heres-why-duckdb-changed-my-workflow?utm_source=hashnode&utm_medium=feed)

So last Monday, my PM mentioned me at Whatsapp group around 9 AM and ask for some analysis sounds familiar, right? Then He drops around 120MB excel file. one hundred twenty megabytes. I should've known better. I tried opening it in Excel. That spinni...

17 min read · [datasquad.hashnode.dev](https://datasquad.hashnode.dev/struggling-with-large-csv-files-heres-why-duckdb-changed-my-workflow?utm_source=hashnode&utm_medium=feed)

[Ghanshyam Digital](https://hashnode.com/@ghanshyamdigital) · [Nov 13, 2025](https://hashnode.com/posts/how-i-saved-800-daily-using-duckdb-and-apache-superset-instead-of-aws-redshift-for-analytics/6915d9ff6ec8f369a1c03491)

### [How I Saved $800+ Daily Using DuckDB & Apache Superset Instead of AWS Redshift for Analytics](https://blog.ghanshyamdigital.com/how-i-saved-800-daily-using-duckdb-and-apache-superset-instead-of-aws-redshift-for-analytics?utm_source=hashnode&utm_medium=feed)

Learn how we replaced AWS Redshift with DuckDB and Apache Superset for loan analytics, cutting costs from $800/day to pennies.

5 min read · [blog.ghanshyamdigital.com](https://blog.ghanshyamdigital.com/how-i-saved-800-daily-using-duckdb-and-apache-superset-instead-of-aws-redshift-for-analytics?utm_source=hashnode&utm_medium=feed)

[Jagdish Parihar](https://hashnode.com/@Jatin510) · [Jul 24, 2025](https://hashnode.com/posts/understanding-parquet-an-efficient-columnar-file-format/6881d875d3081c71fb48ceaa)

### [Understanding Parquet: An Efficient Columnar File Format](https://blog.jatin510.dev/understanding-parquet-an-efficient-columnar-file-format?utm_source=hashnode&utm_medium=feed)

Parquet offers performance, compression, and seamless big data integration benefits, optimized for large-scale analytics as a columnar file format

2 min read · [blog.jatin510.dev](https://blog.jatin510.dev/understanding-parquet-an-efficient-columnar-file-format?utm_source=hashnode&utm_medium=feed)

[Francesco “oha” Rivetti](https://hashnode.com/@oha) · [Jun 24, 2025](https://hashnode.com/posts/b-square/685ad94807dda9ea64f7d838)

### [b-Square: Efficient Geospatial Indexing for Tabular Data](https://blog.oha.it/b-square?utm_source=hashnode&utm_medium=feed)

Filtering billions of geometries without R-trees, cloud optimized

2 min read · [blog.oha.it](https://blog.oha.it/b-square?utm_source=hashnode&utm_medium=feed)

[Islam Elbanna](https://hashnode.com/@ielbanna) · [May 24, 2025](https://hashnode.com/posts/selecting-the-best-file-formats-for-apache-spark-parquet-orc-csv-and-more/6831cb6c0430a86ae9352128)

### [Selecting the Best File Formats for Apache Spark: Parquet, ORC, CSV and more](https://practical-software.com/selecting-the-best-file-formats-for-apache-spark-parquet-orc-csv-and-more?utm_source=hashnode&utm_medium=feed)

Learn how to choose the ideal file format for Apache Spark to optimize performance, storage costs, and query speed, including Parquet, ORC, and more

4 min read · [practical-software.com](https://practical-software.com/selecting-the-best-file-formats-for-apache-spark-parquet-orc-csv-and-more?utm_source=hashnode&utm_medium=feed)

[1](https://hashnode.com/posts/selecting-the-best-file-formats-for-apache-spark-parquet-orc-csv-and-more/6831cb6c0430a86ae9352128)

[Mehul Kansal](https://hashnode.com/@mehulkansal) · [May 11, 2025](https://hashnode.com/posts/22-aws-athena-setup-and-optimization/6820fb594843871363db5d04)

### [22: AWS Athena Setup and Optimization 📊](https://mehulkansal.hashnode.dev/22-aws-athena-setup-and-optimization?utm_source=hashnode&utm_medium=feed)

Hi Data Folks! 👋 In this blog, we’ll walk through setting up AWS Athena for querying data in S3, defining table structures using both manual metadata and Glue Crawlers, and optimizing query performance with techniques like partitioning and columnar ...

6 min read · [mehulkansal.hashnode.dev](https://mehulkansal.hashnode.dev/22-aws-athena-setup-and-optimization?utm_source=hashnode&utm_medium=feed)
