r/programming • u/IiIIIlllllLliLl • 3d ago

ClickHouse outcompresses Parquet: Surprises from our migration

https://tomalard.github.io/posts/clickhouse-outcompresses-parquet-surprises-from-our-migration/

I pinky promise that I'm not a ClickHouse employee

114 Upvotes

95% Upvoted

9 comments sorted by

View all comments

-4

u/coolcosmos 3d ago

Ctrl+f "brotli": zero match

you can't say Parquet is bigger without trying it's most space efficient compression algorithm....

25

u/IiIIIlllllLliLl 3d ago

We did try brotli at some point, it turned out to be way slower for a marginally better result if I remember correctly. In any case, Parquet already has a compression codec advantage (ZSTD 3 vs 11). I don't think I'm being unfair to Parquet here.