My FeedDiscussionsHeadless CMS
New
Sign in
Log inSign up
Learn more about Hashnode Headless CMSHashnode Headless CMS
Collaborate seamlessly with Hashnode Headless CMS for Enterprise.
Upgrade ✨Learn more
Sandeep Pawar

3 likes

·

3.9K reads

3 comments

anantha krishna
anantha krishna
Nov 26, 2023

Hi Sandeep Pawar, Thank You so much for sharing this. For "Row Groups" since it is calculated on "parquet" files and table is in delta format, if there are multiple versions of the table then it is counting for previous version of parquet files also.

·
·2 replies
Sandeep Pawar
Sandeep Pawar
Author
·Nov 26, 2023

Good catch, I have updated the code, please take a look. I am only including the parquet used by latest delta

1
·
anantha krishna
anantha krishna
Nov 27, 2023

Sandeep Pawar , Thank You Guruji, it looks fine now :)

1
·