---
title: "Discussion on \"Comparing a CSV Too Big for Excel Against Last Month's Version — Key Matching on 10 GB With Excel, qsv diff and DuckDB\" | Hashnode"
description: "Discussion on \"Comparing a CSV Too Big for Excel Against Last Month's Version — Key Matching on 10 GB With Excel, qsv diff and DuckDB\". Excel stops at row 1,048,576. Measured key matching of two 10 GB CSV files (about 100 million rows) with qsv diff, DuckDB and UwDiff — losses included."
url: "https://hashnode.com/posts/comparing-a-csv-too-big-for-excel-against-last-month-s-version-key-matching-on-10-gb-with-excel-qsv-diff-and-duckdb/6af6e1f5f596b15fa541d2ea"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Comparing a CSV Too Big for Excel Against Last Month's Version — Key Matching on 10 GB With Excel, qsv diff and DuckDB](https://hugefiles.hashnode.dev/comparing-a-csv-too-big-for-excel-against-last-month-s-version-key-matching-on-10-gb-with-excel-qsv-diff-and-duckdb?utm_source=hashnode&utm_medium=feed)

Excel stops at row 1,048,576. Measured key matching of two 10 GB CSV files (about 100 million rows) with qsv diff, DuckDB and UwDiff — losses included.

2d ago · 6 min read · hugefiles.hashnode.dev  
Read the article

-   [#csv](https://hashnode.com/tag/csv)
-   [#duckdb](https://hashnode.com/tag/duckdb)
-   [#data-engineering](https://hashnode.com/tag/data-engineering)
-   [#command-line](https://hashnode.com/tag/command-line)
-   [#benchmark](https://hashnode.com/tag/benchmark)
-   [#excel](https://hashnode.com/tag/excel)

## Written by

[Yuji Maruyama](https://hashnode.com/@amru1957)

@amru1957 · oita,japan

  
[View profile](https://hashnode.com/@amru1957)

I'm Yuji Maruyama (y4u), an independent developer with more than 40 years in CAD/GIS, radio and geodesy software. I build UwView, a viewer that opens and searches multi-GB logs and text files while it is still indexing, and UwDiff, a tool that compares huge files — text, CSV/Excel tables by key, compressed files, Word and PDF — on Windows, macOS and Linux. I also make geodesy apps for iOS (JP-GeoConverter Pro, JP-GeoPrism, GeoDiveExa). I write about measuring things honestly: every benchmark comes with the machine, the data and the cases where my tools lose. Author of a Kindle series on Japanese geodetic datums (4 books, Japanese) and the alternate-history novel series Enkan Chronicles (8 books, Japanese).

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
