Reducing S3 API Calls by 98% | Exploring the Secrets of OpenDAL's RangeReader
Preface
At GreptimeDB, we utilize OpenDAL as our unified data access layer. Recently, a colleague informed me that it took 10 seconds to execute a Copy From statement to import an 800 KiB Parquet file from S3. After some investigation and reviewing r...
greptime.hashnode.dev8 min read