-
Parquet and Arrow: why columnar formats make your queries 100x faster
Large analytical datasets often start life as CSV files. They are easy to create, easy to open, and supported almost everywhere.
-
Empirical: Parquet vs ORC compression benchmarks
Parquet and ORC are the heavyweights of columnar storage in modern data engineering, each designed for high-performance analytics on massive datasets. In this post, we empirically benchmark both formats under post-2024 workloads, comparing compression ratios, read/write throughput, CPU utilization, and query latency across common engines like Spark, Trino, and DuckDB. The results shed light on…