Skip to content

Sub segment read p2#7368

Draft
joseph-isaacs wants to merge 16 commits intodevelopfrom
ji/sub-segment-read
Draft

Sub segment read p2#7368
joseph-isaacs wants to merge 16 commits intodevelopfrom
ji/sub-segment-read

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

Signed-off-by: Nicholas Gates nick@nickgates.com<!--
Thank you for submitting a pull request! We appreciate your time and effort.

Please make sure to provide enough information so that we can review your pull
request. The Summary and Testing sections below contain guidance on what to
include.
-->

Summary

Closes: #000

Testing

gatesn and others added 15 commits March 19, 2026 10:45
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

# Conflicts:
#	vortex-array/public-api.lock
#	vortex-array/src/array/vtable/dyn_.rs
#	vortex-array/src/array/vtable/mod.rs
#	vortex-array/src/arrays/bool/array.rs
#	vortex-array/src/arrays/fixed_size_list/compute/slice.rs
#	vortex-layout/src/layouts/flat/reader.rs
#	vortex-layout/src/layouts/flat/writer.rs
#	vortex-layout/src/segments/cache.rs
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added action/benchmark Trigger full benchmarks to run on this PR labels Apr 10, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 10, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 1ac4f14 2 Explore Profiling Data
Previous Runs (2)
Status Commit Job Attempt Link
🟢 Done 1ac4f14 1 Explore Profiling Data
🟢 Done 5b3726e 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.140x ❌


datafusion / vortex-file-compressed (1.140x ❌, 0↑ 6↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 129758290 121295058 1.07
polarsignals_q01/datafusion:vortex-file-compressed 386263236 376087669 1.03
polarsignals_q02/datafusion:vortex-file-compressed 24995651 22961330 1.09
polarsignals_q03/datafusion:vortex-file-compressed 🚨 406539912 365136627 1.11
polarsignals_q04/datafusion:vortex-file-compressed 🚨 13734239 11178659 1.23
polarsignals_q05/datafusion:vortex-file-compressed 🚨 19110480 15124368 1.26
polarsignals_q06/datafusion:vortex-file-compressed 🚨 22669794 18942369 1.20
polarsignals_q07/datafusion:vortex-file-compressed 🚨 16960070 13535310 1.25
polarsignals_q08/datafusion:vortex-file-compressed 495386631 471856970 1.05
polarsignals_q09/datafusion:vortex-file-compressed 🚨 11762556 10340468 1.14

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

File Sizes: PolarSignals Profiling

File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 689.09 MB 689.09 MB +232 B +0.0%

Totals:

  • vortex-file-compressed: 689.09 MB → 689.09 MB (+0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +5.3%
Vortex (geomean): 1.072x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish +3.6%


datafusion / vortex-file-compressed (1.050x ➖, 0↑ 2↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 51109452 50461117 1.01
tpch_q02/datafusion:vortex-file-compressed 32689124 32061090 1.02
tpch_q03/datafusion:vortex-file-compressed 28966830 28737359 1.01
tpch_q04/datafusion:vortex-file-compressed 18911694 18031998 1.05
tpch_q05/datafusion:vortex-file-compressed 55836952 52348861 1.07
tpch_q06/datafusion:vortex-file-compressed 🚨 13467686 9573451 1.41
tpch_q07/datafusion:vortex-file-compressed 67627809 63617929 1.06
tpch_q08/datafusion:vortex-file-compressed 46498013 44242725 1.05
tpch_q09/datafusion:vortex-file-compressed 53709858 53239962 1.01
tpch_q10/datafusion:vortex-file-compressed 46865161 45521317 1.03
tpch_q11/datafusion:vortex-file-compressed 18136558 18970039 0.96
tpch_q12/datafusion:vortex-file-compressed 22622834 22041759 1.03
tpch_q13/datafusion:vortex-file-compressed 26097153 26940026 0.97
tpch_q14/datafusion:vortex-file-compressed 🚨 17468384 15739238 1.11
tpch_q15/datafusion:vortex-file-compressed 27441681 25170071 1.09
tpch_q16/datafusion:vortex-file-compressed 25420777 24907018 1.02
tpch_q17/datafusion:vortex-file-compressed 62038245 62105533 1.00
tpch_q18/datafusion:vortex-file-compressed 80380612 80254604 1.00
tpch_q19/datafusion:vortex-file-compressed 24149739 22322775 1.08
tpch_q20/datafusion:vortex-file-compressed 35564474 32499880 1.09
tpch_q21/datafusion:vortex-file-compressed 77663111 73525580 1.06
tpch_q22/datafusion:vortex-file-compressed 16578618 15837731 1.05
datafusion / vortex-compact (1.060x ➖, 0↑ 5↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 59121625 54220362 1.09
tpch_q02/datafusion:vortex-compact 37038539 35982413 1.03
tpch_q03/datafusion:vortex-compact 🚨 33974083 30476909 1.11
tpch_q04/datafusion:vortex-compact 24282072 22525218 1.08
tpch_q05/datafusion:vortex-compact 55261617 55014416 1.00
tpch_q06/datafusion:vortex-compact 🚨 17164334 13236680 1.30
tpch_q07/datafusion:vortex-compact 71070854 68175402 1.04
tpch_q08/datafusion:vortex-compact 51650977 49375142 1.05
tpch_q09/datafusion:vortex-compact 62375064 61852208 1.01
tpch_q10/datafusion:vortex-compact 55678720 52740145 1.06
tpch_q11/datafusion:vortex-compact 19791129 19462396 1.02
tpch_q12/datafusion:vortex-compact 34369624 31399387 1.09
tpch_q13/datafusion:vortex-compact 33899363 35343927 0.96
tpch_q14/datafusion:vortex-compact 🚨 22846427 20650125 1.11
tpch_q15/datafusion:vortex-compact 🚨 37180688 33564252 1.11
tpch_q16/datafusion:vortex-compact 29059635 28661533 1.01
tpch_q17/datafusion:vortex-compact 69694987 66040998 1.06
tpch_q18/datafusion:vortex-compact 83047402 84802355 0.98
tpch_q19/datafusion:vortex-compact 🚨 36319343 31385229 1.16
tpch_q20/datafusion:vortex-compact 40508662 37488194 1.08
tpch_q21/datafusion:vortex-compact 92265304 86129290 1.07
tpch_q22/datafusion:vortex-compact 17543739 18234358 0.96
datafusion / parquet (0.974x ➖, 4↑ 1↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 136231926 129522115 1.05
tpch_q02/datafusion:parquet 68752609 68824580 1.00
tpch_q03/datafusion:parquet 81331783 80609614 1.01
tpch_q04/datafusion:parquet 48229327 47126667 1.02
tpch_q05/datafusion:parquet 101649575 101086143 1.01
tpch_q06/datafusion:parquet 🚀 37226356 44467819 0.84
tpch_q07/datafusion:parquet 111368780 109778460 1.01
tpch_q08/datafusion:parquet 101635215 107540840 0.95
tpch_q09/datafusion:parquet 129590096 136744374 0.95
tpch_q10/datafusion:parquet 120150878 117680351 1.02
tpch_q11/datafusion:parquet 48361256 47978871 1.01
tpch_q12/datafusion:parquet 🚀 78517251 95683697 0.82
tpch_q13/datafusion:parquet 206380600 204834602 1.01
tpch_q14/datafusion:parquet 🚀 46669368 52105523 0.90
tpch_q15/datafusion:parquet 64446518 65793692 0.98
tpch_q16/datafusion:parquet 49551101 49118477 1.01
tpch_q17/datafusion:parquet 🚨 142596619 116843216 1.22
tpch_q18/datafusion:parquet 161246304 170299291 0.95
tpch_q19/datafusion:parquet 🚀 69957698 93769238 0.75
tpch_q20/datafusion:parquet 78325089 77030548 1.02
tpch_q21/datafusion:parquet 149218749 144470614 1.03
tpch_q22/datafusion:parquet 34202229 34506301 0.99
datafusion / arrow (1.005x ➖, 1↑ 2↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 50935767 55695872 0.91
tpch_q02/datafusion:arrow 21581091 21646157 1.00
tpch_q03/datafusion:arrow 32388465 32591127 0.99
tpch_q04/datafusion:arrow 26710510 27710927 0.96
tpch_q05/datafusion:arrow 76457184 80819594 0.95
tpch_q06/datafusion:arrow 19449475 21032872 0.92
tpch_q07/datafusion:arrow 111410940 109753916 1.02
tpch_q08/datafusion:arrow 44390384 43142270 1.03
tpch_q09/datafusion:arrow 70891623 67887543 1.04
tpch_q10/datafusion:arrow 52133502 49941454 1.04
tpch_q11/datafusion:arrow 12099636 11337398 1.07
tpch_q12/datafusion:arrow 🚨 61272243 54792410 1.12
tpch_q13/datafusion:arrow 🚨 54081748 48053905 1.13
tpch_q14/datafusion:arrow 22990214 22744227 1.01
tpch_q15/datafusion:arrow 45080404 43699878 1.03
tpch_q16/datafusion:arrow 21905886 20381688 1.07
tpch_q17/datafusion:arrow 72032174 71065731 1.01
tpch_q18/datafusion:arrow 141168576 139977997 1.01
tpch_q19/datafusion:arrow 🚀 39624849 44538398 0.89
tpch_q20/datafusion:arrow 38062108 40178103 0.95
tpch_q21/datafusion:arrow 152838753 152340694 1.00
tpch_q22/datafusion:arrow 19790163 20064364 0.99
duckdb / vortex-file-compressed (1.107x ❌, 0↑ 12↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 32353709 32919728 0.98
tpch_q02/duckdb:vortex-file-compressed 29951509 27939460 1.07
tpch_q03/duckdb:vortex-file-compressed 🚨 33236637 29666523 1.12
tpch_q04/duckdb:vortex-file-compressed 🚨 33650603 28048315 1.20
tpch_q05/duckdb:vortex-file-compressed 36079739 33826101 1.07
tpch_q06/duckdb:vortex-file-compressed 🚨 12548729 10662852 1.18
tpch_q07/duckdb:vortex-file-compressed 🚨 42996530 36436282 1.18
tpch_q08/duckdb:vortex-file-compressed 42397428 39975373 1.06
tpch_q09/duckdb:vortex-file-compressed 🚨 84399662 75310731 1.12
tpch_q10/duckdb:vortex-file-compressed 🚨 39543902 35752519 1.11
tpch_q11/duckdb:vortex-file-compressed 🚨 17196853 15565614 1.10
tpch_q12/duckdb:vortex-file-compressed 🚨 29812159 21815425 1.37
tpch_q13/duckdb:vortex-file-compressed 38905671 36884096 1.05
tpch_q14/duckdb:vortex-file-compressed 24687683 22725826 1.09
tpch_q15/duckdb:vortex-file-compressed 17580324 16433572 1.07
tpch_q16/duckdb:vortex-file-compressed 🚨 32224634 28983383 1.11
tpch_q17/duckdb:vortex-file-compressed 🚨 29629268 25682261 1.15
tpch_q18/duckdb:vortex-file-compressed 49112241 46973313 1.05
tpch_q19/duckdb:vortex-file-compressed 🚨 33999438 30676184 1.11
tpch_q20/duckdb:vortex-file-compressed 35930701 34225567 1.05
tpch_q21/duckdb:vortex-file-compressed 🚨 114744130 102524953 1.12
tpch_q22/duckdb:vortex-file-compressed 18908884 17901243 1.06
duckdb / vortex-compact (1.072x ➖, 0↑ 9↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39141287 39519265 0.99
tpch_q02/duckdb:vortex-compact 39155643 36221433 1.08
tpch_q03/duckdb:vortex-compact 🚨 36420576 31478819 1.16
tpch_q04/duckdb:vortex-compact 🚨 40029967 34276688 1.17
tpch_q05/duckdb:vortex-compact 🚨 41077483 36065204 1.14
tpch_q06/duckdb:vortex-compact 🚨 17222740 14035803 1.23
tpch_q07/duckdb:vortex-compact 🚨 46403465 42017858 1.10
tpch_q08/duckdb:vortex-compact 48687596 45705123 1.07
tpch_q09/duckdb:vortex-compact 88015274 89014363 0.99
tpch_q10/duckdb:vortex-compact 44320000 40653154 1.09
tpch_q11/duckdb:vortex-compact 20176008 20932586 0.96
tpch_q12/duckdb:vortex-compact 🚨 39907158 35693903 1.12
tpch_q13/duckdb:vortex-compact 43249434 46347912 0.93
tpch_q14/duckdb:vortex-compact 31797459 29370734 1.08
tpch_q15/duckdb:vortex-compact 20046176 18946420 1.06
tpch_q16/duckdb:vortex-compact 🚨 38752799 35065366 1.11
tpch_q17/duckdb:vortex-compact 32990362 31170909 1.06
tpch_q18/duckdb:vortex-compact 50974676 51051723 1.00
tpch_q19/duckdb:vortex-compact 🚨 40599293 36831251 1.10
tpch_q20/duckdb:vortex-compact 47026843 42888767 1.10
tpch_q21/duckdb:vortex-compact 🚨 121492808 110150414 1.10
tpch_q22/duckdb:vortex-compact 21092244 20939141 1.01
duckdb / parquet (1.024x ➖, 1↑ 3↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 105340020 77431046 1.36
tpch_q02/duckdb:parquet 39728734 39214116 1.01
tpch_q03/duckdb:parquet 69621268 68847548 1.01
tpch_q04/duckdb:parquet 🚨 52172185 47229885 1.10
tpch_q05/duckdb:parquet 67970962 66588908 1.02
tpch_q06/duckdb:parquet 20376490 20459717 1.00
tpch_q07/duckdb:parquet 🚀 67351415 80064382 0.84
tpch_q08/duckdb:parquet 81579099 81637191 1.00
tpch_q09/duckdb:parquet 159046748 157883205 1.01
tpch_q10/duckdb:parquet 140320841 139395372 1.01
tpch_q11/duckdb:parquet 22870713 22870695 1.00
tpch_q12/duckdb:parquet 45156172 46941032 0.96
tpch_q13/duckdb:parquet 264781678 261521632 1.01
tpch_q14/duckdb:parquet 47624391 49318727 0.97
tpch_q15/duckdb:parquet 25515568 24256585 1.05
tpch_q16/duckdb:parquet 54261465 55168497 0.98
tpch_q17/duckdb:parquet 58379595 54867027 1.06
tpch_q18/duckdb:parquet 118093693 118437431 1.00
tpch_q19/duckdb:parquet 🚨 76857310 69035364 1.11
tpch_q20/duckdb:parquet 63483827 61942093 1.02
tpch_q21/duckdb:parquet 179294453 165645636 1.08
tpch_q22/duckdb:parquet 51003146 51571264 0.99
duckdb / duckdb (1.017x ➖, 0↑ 0↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15885225 16033673 0.99
tpch_q02/duckdb:duckdb 13118229 12880418 1.02
tpch_q03/duckdb:duckdb 20003385 19811033 1.01
tpch_q04/duckdb:duckdb 18474686 19107535 0.97
tpch_q05/duckdb:duckdb 19728531 20520375 0.96
tpch_q06/duckdb:duckdb 5196841 5339506 0.97
tpch_q07/duckdb:duckdb 22698490 22388878 1.01
tpch_q08/duckdb:duckdb 21177293 20565974 1.03
tpch_q09/duckdb:duckdb 54253671 52671234 1.03
tpch_q10/duckdb:duckdb 42293607 40921104 1.03
tpch_q11/duckdb:duckdb 5635676 5862133 0.96
tpch_q12/duckdb:duckdb 14603034 13538762 1.08
tpch_q13/duckdb:duckdb 38322182 36332796 1.05
tpch_q14/duckdb:duckdb 17556660 15960679 1.10
tpch_q15/duckdb:duckdb 11794108 11887101 0.99
tpch_q16/duckdb:duckdb 23110548 22551026 1.02
tpch_q17/duckdb:duckdb 13561867 13470283 1.01
tpch_q18/duckdb:duckdb 39868620 38222020 1.04
tpch_q19/duckdb:duckdb 26915885 25437699 1.06
tpch_q20/duckdb:duckdb 23129200 22733783 1.02
tpch_q21/duckdb:duckdb 57341176 55980647 1.02
tpch_q22/duckdb:duckdb 24348492 24322749 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -8.5% +19.6% -23.5% +25.7% ✅ faster
1 datafusion:vortex-compact +9.0% +19.6% -8.8% +24.7% ➖ noise
1 datafusion:vortex-file-compressed +1.3% +19.6% -15.3% +25.7% ➖ noise
1 duckdb:duckdb -0.9% +19.6% -17.2% +25.7% ➖ noise
1 duckdb:vortex-compact -1.0% +19.6% -17.2% +25.6% ➖ noise
1 duckdb:vortex-file-compressed -1.7% +19.6% -17.8% +25.8% ➖ noise
2 datafusion:arrow -0.3% +0.6% -0.9% +19.7% ➖ noise
2 datafusion:vortex-compact +2.9% +0.6% +2.3% +19.7% ➖ noise
2 datafusion:vortex-file-compressed +2.0% +0.6% +1.3% +19.7% ➖ noise
2 duckdb:duckdb +1.8% +0.6% +1.2% +19.7% ➖ noise
2 duckdb:vortex-compact +8.1% +0.6% +7.5% +19.7% ➖ noise
2 duckdb:vortex-file-compressed +7.2% +0.6% +6.6% +19.7% ➖ noise
3 datafusion:arrow -0.6% +1.0% -1.6% +19.7% ➖ noise
3 datafusion:vortex-compact +11.5% +1.0% +10.4% +19.7% ➖ noise
3 datafusion:vortex-file-compressed +0.8% +1.0% -0.2% +19.7% ➖ noise
3 duckdb:duckdb +1.0% +1.0% -0.0% +19.7% ➖ noise
3 duckdb:vortex-compact +15.7% +1.0% +14.5% +19.7% ➖ noise
3 duckdb:vortex-file-compressed +12.0% +1.0% +10.9% +19.7% ➖ noise
4 datafusion:arrow -3.6% +6.3% -9.3% +19.7% ➖ noise
4 datafusion:vortex-compact +7.8% +6.3% +1.4% +19.7% ➖ noise
4 datafusion:vortex-file-compressed +4.9% +6.3% -1.4% +19.7% ➖ noise
4 duckdb:duckdb -3.3% +6.3% -9.1% +19.7% ➖ noise
4 duckdb:vortex-compact +16.8% +6.3% +9.8% +19.7% ➖ noise
4 duckdb:vortex-file-compressed +20.0% +6.3% +12.8% +19.7% ➖ noise
5 datafusion:arrow -5.4% +1.3% -6.6% +19.7% ➖ noise
5 datafusion:vortex-compact +0.4% +1.3% -0.9% +19.7% ➖ noise
5 datafusion:vortex-file-compressed +6.7% +1.3% +5.3% +19.7% ➖ noise
5 duckdb:duckdb -3.9% +1.3% -5.1% +19.7% ➖ noise
5 duckdb:vortex-compact +13.9% +1.3% +12.4% +19.7% ➖ noise
5 duckdb:vortex-file-compressed +6.7% +1.3% +5.3% +19.7% ➖ noise
6 datafusion:arrow -7.5% -8.7% +1.3% +33.8% ➖ noise
6 datafusion:vortex-compact +29.7% -8.7% +42.0% +24.8% 🚨 regression
6 datafusion:vortex-file-compressed +40.7% -8.7% +54.1% +24.6% 🚨 regression
6 duckdb:duckdb -2.7% -8.7% +6.6% +29.4% ➖ noise
6 duckdb:vortex-compact +22.7% -8.7% +34.4% +25.2% 🚨 regression
6 duckdb:vortex-file-compressed +17.7% -8.7% +28.9% +28.3% 🚨 regression
7 datafusion:arrow +1.5% -7.6% +9.9% +19.7% ➖ noise
7 datafusion:vortex-compact +4.2% -7.6% +12.8% +19.7% ➖ noise
7 datafusion:vortex-file-compressed +6.3% -7.6% +15.1% +19.7% ➖ noise
7 duckdb:duckdb +1.4% -7.6% +9.7% +19.7% ➖ noise
7 duckdb:vortex-compact +10.4% -7.6% +19.5% +19.7% ➖ noise
7 duckdb:vortex-file-compressed +18.0% -7.6% +27.7% +19.7% 🚨 regression
8 datafusion:arrow +2.9% -2.8% +5.9% +19.7% ➖ noise
8 datafusion:vortex-compact +4.6% -2.8% +7.6% +19.7% ➖ noise
8 datafusion:vortex-file-compressed +5.1% -2.8% +8.1% +19.7% ➖ noise
8 duckdb:duckdb +3.0% -2.8% +6.0% +19.7% ➖ noise
8 duckdb:vortex-compact +6.5% -2.8% +9.6% +19.7% ➖ noise
8 duckdb:vortex-file-compressed +6.1% -2.8% +9.1% +19.7% ➖ noise
9 datafusion:arrow +4.4% -2.3% +6.9% +19.7% ➖ noise
9 datafusion:vortex-compact +0.8% -2.3% +3.2% +19.7% ➖ noise
9 datafusion:vortex-file-compressed +0.9% -2.3% +3.3% +19.7% ➖ noise
9 duckdb:duckdb +3.0% -2.3% +5.4% +19.7% ➖ noise
9 duckdb:vortex-compact -1.1% -2.3% +1.2% +19.7% ➖ noise
9 duckdb:vortex-file-compressed +12.1% -2.3% +14.7% +19.7% ➖ noise
10 datafusion:arrow +4.4% +1.4% +3.0% +19.7% ➖ noise
10 datafusion:vortex-compact +5.6% +1.4% +4.1% +19.7% ➖ noise
10 datafusion:vortex-file-compressed +3.0% +1.4% +1.6% +19.7% ➖ noise
10 duckdb:duckdb +3.4% +1.4% +1.9% +19.7% ➖ noise
10 duckdb:vortex-compact +9.0% +1.4% +7.5% +19.7% ➖ noise
10 duckdb:vortex-file-compressed +10.6% +1.4% +9.1% +19.7% ➖ noise
11 datafusion:arrow +6.7% +0.4% +6.3% +19.7% ➖ noise
11 datafusion:vortex-compact +1.7% +0.4% +1.3% +19.7% ➖ noise
11 datafusion:vortex-file-compressed -4.4% +0.4% -4.8% +19.7% ➖ noise
11 duckdb:duckdb -3.9% +0.4% -4.2% +19.7% ➖ noise
11 duckdb:vortex-compact -3.6% +0.4% -4.0% +19.7% ➖ noise
11 duckdb:vortex-file-compressed +10.5% +0.4% +10.0% +19.7% ➖ noise
12 datafusion:arrow +11.8% -11.2% +25.9% +19.7% 🚨 regression
12 datafusion:vortex-compact +9.5% -11.2% +23.2% +19.7% 🚨 regression
12 datafusion:vortex-file-compressed +2.6% -11.2% +15.5% +19.7% ➖ noise
12 duckdb:duckdb +7.9% -11.2% +21.4% +19.7% 🚨 regression
12 duckdb:vortex-compact +11.8% -11.2% +25.8% +19.7% 🚨 regression
12 duckdb:vortex-file-compressed +36.7% -11.2% +53.8% +19.7% 🚨 regression
13 datafusion:arrow +12.5% +1.0% +11.4% +19.7% ➖ noise
13 datafusion:vortex-compact -4.1% +1.0% -5.0% +19.7% ➖ noise
13 datafusion:vortex-file-compressed -3.1% +1.0% -4.1% +19.7% ➖ noise
13 duckdb:duckdb +5.5% +1.0% +4.4% +19.7% ➖ noise
13 duckdb:vortex-compact -6.7% +1.0% -7.6% +19.7% ➖ noise
13 duckdb:vortex-file-compressed +5.5% +1.0% +4.4% +19.7% ➖ noise
14 datafusion:arrow +1.1% -7.0% +8.7% +19.7% ➖ noise
14 datafusion:vortex-compact +10.6% -7.0% +19.0% +19.7% ➖ noise
14 datafusion:vortex-file-compressed +11.0% -7.0% +19.3% +19.7% ➖ noise
14 duckdb:duckdb +10.0% -7.0% +18.3% +27.2% ➖ noise
14 duckdb:vortex-compact +8.3% -7.0% +16.4% +19.7% ➖ noise
14 duckdb:vortex-file-compressed +8.6% -7.0% +16.8% +19.7% ➖ noise
15 datafusion:arrow +3.2% +1.5% +1.6% +19.7% ➖ noise
15 datafusion:vortex-compact +10.8% +1.5% +9.1% +19.7% ➖ noise
15 datafusion:vortex-file-compressed +9.0% +1.5% +7.4% +19.7% ➖ noise
15 duckdb:duckdb -0.8% +1.5% -2.3% +19.7% ➖ noise
15 duckdb:vortex-compact +5.8% +1.5% +4.2% +19.7% ➖ noise
15 duckdb:vortex-file-compressed +7.0% +1.5% +5.4% +19.7% ➖ noise
16 datafusion:arrow +7.5% -0.4% +7.9% +19.7% ➖ noise
16 datafusion:vortex-compact +1.4% -0.4% +1.8% +19.7% ➖ noise
16 datafusion:vortex-file-compressed +2.1% -0.4% +2.5% +19.7% ➖ noise
16 duckdb:duckdb +2.5% -0.4% +2.9% +19.7% ➖ noise
16 duckdb:vortex-compact +10.5% -0.4% +10.9% +19.7% ➖ noise
16 duckdb:vortex-file-compressed +11.2% -0.4% +11.6% +19.7% ➖ noise
17 datafusion:arrow +1.4% +14.0% -11.1% +19.7% ➖ noise
17 datafusion:vortex-compact +5.5% +14.0% -7.4% +19.8% ➖ noise
17 datafusion:vortex-file-compressed -0.1% +14.0% -12.3% +19.7% ➖ noise
17 duckdb:duckdb +0.7% +14.0% -11.6% +19.7% ➖ noise
17 duckdb:vortex-compact +5.8% +14.0% -7.1% +20.2% ➖ noise
17 duckdb:vortex-file-compressed +15.4% +14.0% +1.2% +20.5% ➖ noise
18 datafusion:arrow +0.9% -2.8% +3.8% +19.7% ➖ noise
18 datafusion:vortex-compact -2.1% -2.8% +0.8% +19.7% ➖ noise
18 datafusion:vortex-file-compressed +0.2% -2.8% +3.1% +19.7% ➖ noise
18 duckdb:duckdb +4.3% -2.8% +7.4% +19.7% ➖ noise
18 duckdb:vortex-compact -0.2% -2.8% +2.8% +19.7% ➖ noise
18 duckdb:vortex-file-compressed +4.6% -2.8% +7.6% +19.7% ➖ noise
19 datafusion:arrow -11.0% -8.9% -2.4% +19.7% ➖ noise
19 datafusion:vortex-compact +15.7% -8.9% +27.0% +19.7% 🚨 regression
19 datafusion:vortex-file-compressed +8.2% -8.9% +18.7% +19.7% ➖ noise
19 duckdb:duckdb +5.8% -8.9% +16.1% +24.1% ➖ noise
19 duckdb:vortex-compact +10.2% -8.9% +21.0% +19.7% 🚨 regression
19 duckdb:vortex-file-compressed +10.8% -8.9% +21.6% +19.7% 🚨 regression
20 datafusion:arrow -5.3% +2.1% -7.2% +19.7% ➖ noise
20 datafusion:vortex-compact +8.1% +2.1% +5.9% +19.7% ➖ noise
20 datafusion:vortex-file-compressed +9.4% +2.1% +7.2% +19.7% ➖ noise
20 duckdb:duckdb +1.7% +2.1% -0.3% +19.7% ➖ noise
20 duckdb:vortex-compact +9.6% +2.1% +7.4% +19.7% ➖ noise
20 duckdb:vortex-file-compressed +5.0% +2.1% +2.8% +19.9% ➖ noise
21 datafusion:arrow +0.3% +5.7% -5.1% +19.7% ➖ noise
21 datafusion:vortex-compact +7.1% +5.7% +1.3% +19.7% ➖ noise
21 datafusion:vortex-file-compressed +5.6% +5.7% -0.1% +19.7% ➖ noise
21 duckdb:duckdb +2.4% +5.7% -3.1% +19.7% ➖ noise
21 duckdb:vortex-compact +10.3% +5.7% +4.3% +19.7% ➖ noise
21 duckdb:vortex-file-compressed +11.9% +5.7% +5.8% +19.7% ➖ noise
22 datafusion:arrow -1.4% -1.0% -0.4% +19.7% ➖ noise
22 datafusion:vortex-compact -3.8% -1.0% -2.8% +19.7% ➖ noise
22 datafusion:vortex-file-compressed +4.7% -1.0% +5.7% +19.7% ➖ noise
22 duckdb:duckdb +0.1% -1.0% +1.1% +19.7% ➖ noise
22 duckdb:vortex-compact +0.7% -1.0% +1.7% +19.7% ➖ noise
22 duckdb:vortex-file-compressed +5.6% -1.0% +6.7% +19.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -4.5%
Vortex (geomean): 0.999x ➖
Parquet (geomean): 1.046x ➖
Shifts: Parquet (control) +4.6% · Median polish +5.9%


datafusion / vortex-file-compressed (1.072x ➖, 2↑ 5↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 5514023 4249023 1.30
fineweb_q01/datafusion:vortex-file-compressed 🚀 22949185 25726064 0.89
fineweb_q02/datafusion:vortex-file-compressed 27744917 29077512 0.95
fineweb_q03/datafusion:vortex-file-compressed 🚨 143031933 79462579 1.80
fineweb_q04/datafusion:vortex-file-compressed 🚨 306496170 260233568 1.18
fineweb_q05/datafusion:vortex-file-compressed 262976735 241382639 1.09
fineweb_q06/datafusion:vortex-file-compressed 🚨 86844404 63998290 1.36
fineweb_q07/datafusion:vortex-file-compressed 🚨 85950280 69187071 1.24
fineweb_q08/datafusion:vortex-file-compressed 🚀 10666534 24499023 0.44
datafusion / vortex-compact (0.936x ➖, 1↑ 1↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 5379502 4793735 1.12
fineweb_q01/datafusion:vortex-compact 161984001 163832892 0.99
fineweb_q02/datafusion:vortex-compact 163791710 165142881 0.99
fineweb_q03/datafusion:vortex-compact 1517226378 1431351114 1.06
fineweb_q04/datafusion:vortex-compact 1621034617 1557720018 1.04
fineweb_q05/datafusion:vortex-compact 1277443346 1233311228 1.04
fineweb_q06/datafusion:vortex-compact 728877837 700258333 1.04
fineweb_q07/datafusion:vortex-compact 749971563 731093355 1.03
fineweb_q08/datafusion:vortex-compact 🚀 8807798 21490878 0.41
datafusion / parquet (1.062x ➖, 0↑ 1↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 6897410 6237628 1.11
fineweb_q01/datafusion:parquet 280579613 269782335 1.04
fineweb_q02/datafusion:parquet 281439384 268543157 1.05
fineweb_q03/datafusion:parquet 283265047 263194791 1.08
fineweb_q04/datafusion:parquet 298538424 278498706 1.07
fineweb_q05/datafusion:parquet 293091397 273340018 1.07
fineweb_q06/datafusion:parquet 285094519 276721391 1.03
fineweb_q07/datafusion:parquet 280065473 265748632 1.05
fineweb_q08/datafusion:parquet 276825304 259929345 1.07
duckdb / vortex-file-compressed (1.038x ➖, 2↑ 6↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 3813449 3303536 1.15
fineweb_q01/duckdb:vortex-file-compressed 🚀 23946941 26922618 0.89
fineweb_q02/duckdb:vortex-file-compressed 🚨 30822059 24830345 1.24
fineweb_q03/duckdb:vortex-file-compressed 🚨 201862120 127888974 1.58
fineweb_q04/duckdb:vortex-file-compressed 🚨 276987975 239376465 1.16
fineweb_q05/duckdb:vortex-file-compressed 🚨 246123990 218446919 1.13
fineweb_q06/duckdb:vortex-file-compressed 🚨 76630394 65254456 1.17
fineweb_q07/duckdb:vortex-file-compressed 74347434 68728955 1.08
fineweb_q08/duckdb:vortex-file-compressed 🚀 10151749 24099827 0.42
duckdb / vortex-compact (0.956x ➖, 1↑ 1↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 4758055 3911580 1.22
fineweb_q01/duckdb:vortex-compact 111019831 106402705 1.04
fineweb_q02/duckdb:vortex-compact 119789492 122876344 0.97
fineweb_q03/duckdb:vortex-compact 902271938 872109676 1.03
fineweb_q04/duckdb:vortex-compact 959678315 909099198 1.06
fineweb_q05/duckdb:vortex-compact 848603713 807944785 1.05
fineweb_q06/duckdb:vortex-compact 478336737 471659789 1.01
fineweb_q07/duckdb:vortex-compact 494276650 479099533 1.03
fineweb_q08/duckdb:vortex-compact 🚀 9762707 21811893 0.45
duckdb / parquet (1.029x ➖, 0↑ 0↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 37509453 36467094 1.03
fineweb_q01/duckdb:parquet 95818106 92489264 1.04
fineweb_q02/duckdb:parquet 99386996 96896969 1.03
fineweb_q03/duckdb:parquet 314535378 305252430 1.03
fineweb_q04/duckdb:parquet 445593642 437843060 1.02
fineweb_q05/duckdb:parquet 415919716 407984997 1.02
fineweb_q06/duckdb:parquet 203918982 197868097 1.03
fineweb_q07/duckdb:parquet 213988010 208663648 1.03
fineweb_q08/duckdb:parquet 60988216 58155706 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +12.2% +6.6% +5.2% +37.6% ➖ noise
0 datafusion:vortex-file-compressed +29.8% +6.6% +21.7% +81.8% ➖ noise
0 duckdb:vortex-compact +21.6% +6.6% +14.1% +37.1% ➖ noise
0 duckdb:vortex-file-compressed +15.4% +6.6% +8.2% +48.5% ➖ noise
1 datafusion:vortex-compact -1.1% +3.8% -4.7% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -10.8% +3.8% -14.1% +18.5% ➖ noise
1 duckdb:vortex-compact +4.3% +3.8% +0.5% +20.6% ➖ noise
1 duckdb:vortex-file-compressed -11.1% +3.8% -14.3% +42.3% ➖ noise
2 datafusion:vortex-compact -0.8% +3.7% -4.3% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -4.6% +3.7% -8.0% +16.7% ➖ noise
2 duckdb:vortex-compact -2.5% +3.7% -6.0% +15.1% ➖ noise
2 duckdb:vortex-file-compressed +24.1% +3.7% +19.7% +10.0% 🚨 regression
3 datafusion:vortex-compact +6.0% +5.3% +0.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +80.0% +5.3% +70.9% +25.7% 🚨 regression
3 duckdb:vortex-compact +3.5% +5.3% -1.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +57.8% +5.3% +49.9% +22.8% 🚨 regression
4 datafusion:vortex-compact +4.1% +4.4% -0.4% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +17.8% +4.4% +12.8% +10.0% 🚨 regression
4 duckdb:vortex-compact +5.6% +4.4% +1.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +15.7% +4.4% +10.8% +10.0% 🚨 regression
5 datafusion:vortex-compact +3.6% +4.6% -0.9% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +8.9% +4.6% +4.2% +10.0% ➖ noise
5 duckdb:vortex-compact +5.0% +4.6% +0.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +12.7% +4.6% +7.8% +10.0% ➖ noise
6 datafusion:vortex-compact +4.1% +3.0% +1.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +35.7% +3.0% +31.7% +16.2% 🚨 regression
6 duckdb:vortex-compact +1.4% +3.0% -1.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +17.4% +3.0% +14.0% +17.9% ➖ noise
7 datafusion:vortex-compact +2.6% +4.0% -1.3% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +24.2% +4.0% +19.5% +10.0% 🚨 regression
7 duckdb:vortex-compact +3.2% +4.0% -0.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +8.2% +4.0% +4.1% +10.0% ➖ noise
8 datafusion:vortex-compact -59.0% +5.7% -61.2% +20.9% ✅ faster
8 datafusion:vortex-file-compressed -56.5% +5.7% -58.8% +47.3% ✅ faster
8 duckdb:vortex-compact -55.2% +5.7% -57.6% +16.5% ✅ faster
8 duckdb:vortex-file-compressed -57.9% +5.7% -60.1% +20.3% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Vortex (geomean): 1.011x ➖
Parquet (geomean): 0.996x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.2%


datafusion / vortex-file-compressed (1.000x ➖, 0↑ 5↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 26336329 28118338 0.94
tpcds_q02/datafusion:vortex-file-compressed 53758861 51375622 1.05
tpcds_q03/datafusion:vortex-file-compressed 20447967 19790865 1.03
tpcds_q04/datafusion:vortex-file-compressed 288932436 290545952 0.99
tpcds_q05/datafusion:vortex-file-compressed 52781397 56390177 0.94
tpcds_q06/datafusion:vortex-file-compressed 49383477 49630265 1.00
tpcds_q07/datafusion:vortex-file-compressed 51116712 50027512 1.02
tpcds_q08/datafusion:vortex-file-compressed 35054562 37550832 0.93
tpcds_q09/datafusion:vortex-file-compressed 🚨 54938692 48492493 1.13
tpcds_q10/datafusion:vortex-file-compressed 43682814 45177274 0.97
tpcds_q11/datafusion:vortex-file-compressed 162450893 167095241 0.97
tpcds_q12/datafusion:vortex-file-compressed 23328821 23055812 1.01
tpcds_q13/datafusion:vortex-file-compressed 53625872 53404751 1.00
tpcds_q14/datafusion:vortex-file-compressed 196073794 201746475 0.97
tpcds_q15/datafusion:vortex-file-compressed 32698992 33282147 0.98
tpcds_q16/datafusion:vortex-file-compressed 27976797 28565207 0.98
tpcds_q17/datafusion:vortex-file-compressed 64339498 66572515 0.97
tpcds_q18/datafusion:vortex-file-compressed 78559166 78701903 1.00
tpcds_q19/datafusion:vortex-file-compressed 29583937 30185880 0.98
tpcds_q20/datafusion:vortex-file-compressed 25040959 26082501 0.96
tpcds_q21/datafusion:vortex-file-compressed 137633293 139965048 0.98
tpcds_q22/datafusion:vortex-file-compressed 57842687 57511506 1.01
tpcds_q23/datafusion:vortex-file-compressed 145243766 147300037 0.99
tpcds_q24/datafusion:vortex-file-compressed 110452864 114945343 0.96
tpcds_q25/datafusion:vortex-file-compressed 65455691 66205061 0.99
tpcds_q26/datafusion:vortex-file-compressed 36354681 36645270 0.99
tpcds_q27/datafusion:vortex-file-compressed 117217487 116768175 1.00
tpcds_q28/datafusion:vortex-file-compressed 44734837 44203384 1.01
tpcds_q29/datafusion:vortex-file-compressed 64225950 66764523 0.96
tpcds_q30/datafusion:vortex-file-compressed 29738756 29987123 0.99
tpcds_q31/datafusion:vortex-file-compressed 96599451 94606481 1.02
tpcds_q32/datafusion:vortex-file-compressed 20296881 22305030 0.91
tpcds_q33/datafusion:vortex-file-compressed 37223898 37149642 1.00
tpcds_q34/datafusion:vortex-file-compressed 31501434 31635264 1.00
tpcds_q35/datafusion:vortex-file-compressed 51732362 54742027 0.95
tpcds_q36/datafusion:vortex-file-compressed 76059151 74133281 1.03
tpcds_q37/datafusion:vortex-file-compressed 🚨 41291740 34141742 1.21
tpcds_q38/datafusion:vortex-file-compressed 51034409 52397744 0.97
tpcds_q39/datafusion:vortex-file-compressed 136067639 138207076 0.98
tpcds_q40/datafusion:vortex-file-compressed 52667548 51911481 1.01
tpcds_q41/datafusion:vortex-file-compressed 18422647 17107239 1.08
tpcds_q42/datafusion:vortex-file-compressed 18565267 17993278 1.03
tpcds_q43/datafusion:vortex-file-compressed 32100160 32344635 0.99
tpcds_q44/datafusion:vortex-file-compressed 44871276 44038056 1.02
tpcds_q45/datafusion:vortex-file-compressed 33933362 34366515 0.99
tpcds_q46/datafusion:vortex-file-compressed 47322343 46542827 1.02
tpcds_q47/datafusion:vortex-file-compressed 200535444 201474220 1.00
tpcds_q48/datafusion:vortex-file-compressed 🚨 48421989 43668054 1.11
tpcds_q49/datafusion:vortex-file-compressed 🚨 75212465 65524298 1.15
tpcds_q50/datafusion:vortex-file-compressed 45010744 45643459 0.99
tpcds_q51/datafusion:vortex-file-compressed 91950151 87831361 1.05
tpcds_q52/datafusion:vortex-file-compressed 19027214 18680416 1.02
tpcds_q53/datafusion:vortex-file-compressed 25526165 24853076 1.03
tpcds_q54/datafusion:vortex-file-compressed 43854369 43973940 1.00
tpcds_q55/datafusion:vortex-file-compressed 17451054 18904878 0.92
tpcds_q56/datafusion:vortex-file-compressed 39842206 39885114 1.00
tpcds_q57/datafusion:vortex-file-compressed 126141377 127468504 0.99
tpcds_q58/datafusion:vortex-file-compressed 69972892 69602011 1.01
tpcds_q59/datafusion:vortex-file-compressed 72123959 70810882 1.02
tpcds_q60/datafusion:vortex-file-compressed 41568667 39978881 1.04
tpcds_q61/datafusion:vortex-file-compressed 50920694 49725848 1.02
tpcds_q62/datafusion:vortex-file-compressed 31230262 31189613 1.00
tpcds_q63/datafusion:vortex-file-compressed 25745691 24880278 1.03
tpcds_q64/datafusion:vortex-file-compressed 462940301 468016138 0.99
tpcds_q65/datafusion:vortex-file-compressed 48353656 49539627 0.98
tpcds_q66/datafusion:vortex-file-compressed 90353009 94754642 0.95
tpcds_q67/datafusion:vortex-file-compressed 117712894 117247807 1.00
tpcds_q68/datafusion:vortex-file-compressed 45137330 45139528 1.00
tpcds_q69/datafusion:vortex-file-compressed 40536076 42256666 0.96
tpcds_q70/datafusion:vortex-file-compressed 112782617 113359902 0.99
tpcds_q71/datafusion:vortex-file-compressed 33194017 30318885 1.09
tpcds_q72/datafusion:vortex-file-compressed 2573601280 2594459481 0.99
tpcds_q73/datafusion:vortex-file-compressed 34319666 33323866 1.03
tpcds_q74/datafusion:vortex-file-compressed 115349067 115141725 1.00
tpcds_q75/datafusion:vortex-file-compressed 116779714 114947879 1.02
tpcds_q76/datafusion:vortex-file-compressed 33395072 33113937 1.01
tpcds_q77/datafusion:vortex-file-compressed 49609344 52215614 0.95
tpcds_q78/datafusion:vortex-file-compressed 123387779 125466475 0.98
tpcds_q79/datafusion:vortex-file-compressed 36827661 37839087 0.97
tpcds_q80/datafusion:vortex-file-compressed 114930973 112390660 1.02
tpcds_q81/datafusion:vortex-file-compressed 38331710 35771291 1.07
tpcds_q82/datafusion:vortex-file-compressed 🚨 41101635 35721672 1.15
tpcds_q83/datafusion:vortex-file-compressed 50818899 51159644 0.99
tpcds_q84/datafusion:vortex-file-compressed 14837400 15379464 0.96
tpcds_q85/datafusion:vortex-file-compressed 101822334 102114877 1.00
tpcds_q86/datafusion:vortex-file-compressed 18713081 19351649 0.97
tpcds_q87/datafusion:vortex-file-compressed 52088699 52660544 0.99
tpcds_q88/datafusion:vortex-file-compressed 72942190 74674116 0.98
tpcds_q89/datafusion:vortex-file-compressed 36062059 35902874 1.00
tpcds_q90/datafusion:vortex-file-compressed 17671929 17654330 1.00
tpcds_q91/datafusion:vortex-file-compressed 25544437 25743568 0.99
tpcds_q92/datafusion:vortex-file-compressed 17750398 19191263 0.92
tpcds_q93/datafusion:vortex-file-compressed 33406137 33978360 0.98
tpcds_q94/datafusion:vortex-file-compressed 24980744 25146311 0.99
tpcds_q95/datafusion:vortex-file-compressed 60139981 59742888 1.01
tpcds_q96/datafusion:vortex-file-compressed 15518708 15378994 1.01
tpcds_q97/datafusion:vortex-file-compressed 29826197 30728283 0.97
tpcds_q98/datafusion:vortex-file-compressed 32149923 33114490 0.97
tpcds_q99/datafusion:vortex-file-compressed 44378409 46730058 0.95
datafusion / vortex-compact (1.005x ➖, 0↑ 3↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 35477051 36183149 0.98
tpcds_q02/datafusion:vortex-compact 60153760 59773127 1.01
tpcds_q03/datafusion:vortex-compact 26211666 26550564 0.99
tpcds_q04/datafusion:vortex-compact 328418710 328210524 1.00
tpcds_q05/datafusion:vortex-compact 64132452 65635221 0.98
tpcds_q06/datafusion:vortex-compact 56777225 57482812 0.99
tpcds_q07/datafusion:vortex-compact 67207530 66062048 1.02
tpcds_q08/datafusion:vortex-compact 44862037 44609692 1.01
tpcds_q09/datafusion:vortex-compact 🚨 77161833 69488141 1.11
tpcds_q10/datafusion:vortex-compact 66039040 64178207 1.03
tpcds_q11/datafusion:vortex-compact 193130543 190174575 1.02
tpcds_q12/datafusion:vortex-compact 27255847 28084277 0.97
tpcds_q13/datafusion:vortex-compact 115895966 107347290 1.08
tpcds_q14/datafusion:vortex-compact 253405174 256550188 0.99
tpcds_q15/datafusion:vortex-compact 37878747 39880452 0.95
tpcds_q16/datafusion:vortex-compact 39611804 39420593 1.00
tpcds_q17/datafusion:vortex-compact 97299698 93291145 1.04
tpcds_q18/datafusion:vortex-compact 90454824 88102199 1.03
tpcds_q19/datafusion:vortex-compact 44386676 44040864 1.01
tpcds_q20/datafusion:vortex-compact 28871231 29746949 0.97
tpcds_q21/datafusion:vortex-compact 140094626 144345131 0.97
tpcds_q22/datafusion:vortex-compact 64027282 67447972 0.95
tpcds_q23/datafusion:vortex-compact 181201968 181240065 1.00
tpcds_q24/datafusion:vortex-compact 141604752 140676113 1.01
tpcds_q25/datafusion:vortex-compact 96314590 97270696 0.99
tpcds_q26/datafusion:vortex-compact 47351835 46192661 1.03
tpcds_q27/datafusion:vortex-compact 158369919 157873054 1.00
tpcds_q28/datafusion:vortex-compact 83442605 83036121 1.00
tpcds_q29/datafusion:vortex-compact 93966108 94656636 0.99
tpcds_q30/datafusion:vortex-compact 34016472 34458192 0.99
tpcds_q31/datafusion:vortex-compact 134326919 132415346 1.01
tpcds_q32/datafusion:vortex-compact 26780632 27302840 0.98
tpcds_q33/datafusion:vortex-compact 54406396 55247651 0.98
tpcds_q34/datafusion:vortex-compact 51648535 51680384 1.00
tpcds_q35/datafusion:vortex-compact 70164683 68121077 1.03
tpcds_q36/datafusion:vortex-compact 98274555 99250739 0.99
tpcds_q37/datafusion:vortex-compact 🚨 52531454 47096863 1.12
tpcds_q38/datafusion:vortex-compact 67893033 69241780 0.98
tpcds_q39/datafusion:vortex-compact 144850953 145114827 1.00
tpcds_q40/datafusion:vortex-compact 56309333 58226737 0.97
tpcds_q41/datafusion:vortex-compact 20758415 21394725 0.97
tpcds_q42/datafusion:vortex-compact 24643783 25641168 0.96
tpcds_q43/datafusion:vortex-compact 37704425 38375715 0.98
tpcds_q44/datafusion:vortex-compact 74251226 73337114 1.01
tpcds_q45/datafusion:vortex-compact 39474645 39197954 1.01
tpcds_q46/datafusion:vortex-compact 73466932 72091414 1.02
tpcds_q47/datafusion:vortex-compact 229468151 230965000 0.99
tpcds_q48/datafusion:vortex-compact 85466514 80118954 1.07
tpcds_q49/datafusion:vortex-compact 97555627 89574662 1.09
tpcds_q50/datafusion:vortex-compact 65227233 66003735 0.99
tpcds_q51/datafusion:vortex-compact 98264071 97980501 1.00
tpcds_q52/datafusion:vortex-compact 24532853 24943970 0.98
tpcds_q53/datafusion:vortex-compact 35508517 37699554 0.94
tpcds_q54/datafusion:vortex-compact 60360200 60982097 0.99
tpcds_q55/datafusion:vortex-compact 24549586 24533207 1.00
tpcds_q56/datafusion:vortex-compact 56333259 57354204 0.98
tpcds_q57/datafusion:vortex-compact 137704470 137738957 1.00
tpcds_q58/datafusion:vortex-compact 79736056 79169224 1.01
tpcds_q59/datafusion:vortex-compact 85601894 87612335 0.98
tpcds_q60/datafusion:vortex-compact 57401601 56547065 1.02
tpcds_q61/datafusion:vortex-compact 77858468 76117133 1.02
tpcds_q62/datafusion:vortex-compact 34743556 32883959 1.06
tpcds_q63/datafusion:vortex-compact 36447340 35313232 1.03
tpcds_q64/datafusion:vortex-compact 546901194 543080466 1.01
tpcds_q65/datafusion:vortex-compact 68376664 67847655 1.01
tpcds_q66/datafusion:vortex-compact 99493599 97974679 1.02
tpcds_q67/datafusion:vortex-compact 125994627 127581845 0.99
tpcds_q68/datafusion:vortex-compact 71366278 71396832 1.00
tpcds_q69/datafusion:vortex-compact 62019933 61527088 1.01
tpcds_q70/datafusion:vortex-compact 128070907 121782196 1.05
tpcds_q71/datafusion:vortex-compact 47868115 46192686 1.04
tpcds_q72/datafusion:vortex-compact 2583226352 2590833501 1.00
tpcds_q73/datafusion:vortex-compact 54031649 52944357 1.02
tpcds_q74/datafusion:vortex-compact 135161759 135593295 1.00
tpcds_q75/datafusion:vortex-compact 165250696 161560719 1.02
tpcds_q76/datafusion:vortex-compact 51757312 49882820 1.04
tpcds_q77/datafusion:vortex-compact 69414600 66796820 1.04
tpcds_q78/datafusion:vortex-compact 151525607 149879377 1.01
tpcds_q79/datafusion:vortex-compact 61909059 62622410 0.99
tpcds_q80/datafusion:vortex-compact 134808229 134908557 1.00
tpcds_q81/datafusion:vortex-compact 43120338 40192818 1.07
tpcds_q82/datafusion:vortex-compact 🚨 54468150 48364215 1.13
tpcds_q83/datafusion:vortex-compact 57175984 59219958 0.97
tpcds_q84/datafusion:vortex-compact 18586512 18881610 0.98
tpcds_q85/datafusion:vortex-compact 125707650 126123675 1.00
tpcds_q86/datafusion:vortex-compact 22293699 22532929 0.99
tpcds_q87/datafusion:vortex-compact 68907838 71104776 0.97
tpcds_q88/datafusion:vortex-compact 122800427 122613129 1.00
tpcds_q89/datafusion:vortex-compact 45383082 44889457 1.01
tpcds_q90/datafusion:vortex-compact 24060431 24046679 1.00
tpcds_q91/datafusion:vortex-compact 39846118 40372746 0.99
tpcds_q92/datafusion:vortex-compact 24767081 25398873 0.98
tpcds_q93/datafusion:vortex-compact 46459061 46826461 0.99
tpcds_q94/datafusion:vortex-compact 31090708 30894778 1.01
tpcds_q95/datafusion:vortex-compact 73879463 72738572 1.02
tpcds_q96/datafusion:vortex-compact 25165398 23938178 1.05
tpcds_q97/datafusion:vortex-compact 44427015 44491531 1.00
tpcds_q98/datafusion:vortex-compact 38192057 40238182 0.95
tpcds_q99/datafusion:vortex-compact 49312570 50743691 0.97
datafusion / parquet (0.994x ➖, 0↑ 2↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 35176574 37670847 0.93
tpcds_q02/datafusion:parquet 46210327 45627999 1.01
tpcds_q03/datafusion:parquet 14517362 15805177 0.92
tpcds_q04/datafusion:parquet 311362226 316378736 0.98
tpcds_q05/datafusion:parquet 52989118 52518792 1.01
tpcds_q06/datafusion:parquet 65260072 65725913 0.99
tpcds_q07/datafusion:parquet 87019646 85961138 1.01
tpcds_q08/datafusion:parquet 33878638 32896487 1.03
tpcds_q09/datafusion:parquet 57578819 55821234 1.03
tpcds_q10/datafusion:parquet 83398116 82111435 1.02
tpcds_q11/datafusion:parquet 181107574 187995067 0.96
tpcds_q12/datafusion:parquet 21757706 22043559 0.99
tpcds_q13/datafusion:parquet 84558901 85324377 0.99
tpcds_q14/datafusion:parquet 189491806 195794310 0.97
tpcds_q15/datafusion:parquet 25795552 28425720 0.91
tpcds_q16/datafusion:parquet 28171272 29319846 0.96
tpcds_q17/datafusion:parquet 68772398 71254066 0.97
tpcds_q18/datafusion:parquet 130775906 130529206 1.00
tpcds_q19/datafusion:parquet 27616639 27988350 0.99
tpcds_q20/datafusion:parquet 20767439 21507620 0.97
tpcds_q21/datafusion:parquet 21877788 22540258 0.97
tpcds_q22/datafusion:parquet 130435188 137331277 0.95
tpcds_q23/datafusion:parquet 160153992 160246376 1.00
tpcds_q24/datafusion:parquet 103685006 105397160 0.98
tpcds_q25/datafusion:parquet 69588161 73479149 0.95
tpcds_q26/datafusion:parquet 75704823 75024721 1.01
tpcds_q27/datafusion:parquet 162590819 162183477 1.00
tpcds_q28/datafusion:parquet 48066699 48090048 1.00
tpcds_q29/datafusion:parquet 75532666 73187814 1.03
tpcds_q30/datafusion:parquet 43256860 45270073 0.96
tpcds_q31/datafusion:parquet 74349733 76393715 0.97
tpcds_q32/datafusion:parquet 22716644 22686453 1.00
tpcds_q33/datafusion:parquet 34478781 35036784 0.98
tpcds_q34/datafusion:parquet 26898667 26521961 1.01
tpcds_q35/datafusion:parquet 82922458 83224965 1.00
tpcds_q36/datafusion:parquet 62730769 62627706 1.00
tpcds_q37/datafusion:parquet 24797325 24147196 1.03
tpcds_q38/datafusion:parquet 49393554 49244753 1.00
tpcds_q39/datafusion:parquet 80499606 82693373 0.97
tpcds_q40/datafusion:parquet 27174588 27194864 1.00
tpcds_q41/datafusion:parquet 15587638 16968969 0.92
tpcds_q42/datafusion:parquet 13822142 14090777 0.98
tpcds_q43/datafusion:parquet 18887198 19096407 0.99
tpcds_q44/datafusion:parquet 40733573 42661549 0.95
tpcds_q45/datafusion:parquet 33112473 32958768 1.00
tpcds_q46/datafusion:parquet 38404149 39007721 0.98
tpcds_q47/datafusion:parquet 136221932 133931582 1.02
tpcds_q48/datafusion:parquet 79914655 80275623 1.00
tpcds_q49/datafusion:parquet 64517944 65366672 0.99
tpcds_q50/datafusion:parquet 47917175 47778173 1.00
tpcds_q51/datafusion:parquet 89169339 87767020 1.02
tpcds_q52/datafusion:parquet 14956745 14012640 1.07
tpcds_q53/datafusion:parquet 20721659 22202067 0.93
tpcds_q54/datafusion:parquet 41842238 42812579 0.98
tpcds_q55/datafusion:parquet 13640157 13615468 1.00
tpcds_q56/datafusion:parquet 36472661 35311935 1.03
tpcds_q57/datafusion:parquet 108046611 104112325 1.04
tpcds_q58/datafusion:parquet 58077520 57376433 1.01
tpcds_q59/datafusion:parquet 58993752 59739427 0.99
tpcds_q60/datafusion:parquet 34225940 34754813 0.98
tpcds_q61/datafusion:parquet 50783109 50788304 1.00
tpcds_q62/datafusion:parquet 29403408 28711856 1.02
tpcds_q63/datafusion:parquet 21130047 22022768 0.96
tpcds_q64/datafusion:parquet 554584204 551033371 1.01
tpcds_q65/datafusion:parquet 44943394 43891882 1.02
tpcds_q66/datafusion:parquet 78711095 76937381 1.02
tpcds_q67/datafusion:parquet 152340104 155104051 0.98
tpcds_q68/datafusion:parquet 39018816 40395858 0.97
tpcds_q69/datafusion:parquet 78094773 78611169 0.99
tpcds_q70/datafusion:parquet 97006292 98659842 0.98
tpcds_q71/datafusion:parquet 27001045 26136460 1.03
tpcds_q72/datafusion:parquet 629950859 642252560 0.98
tpcds_q73/datafusion:parquet 26168728 27731217 0.94
tpcds_q74/datafusion:parquet 103662129 107043829 0.97
tpcds_q75/datafusion:parquet 114834015 117323524 0.98
tpcds_q76/datafusion:parquet 34886952 35479770 0.98
tpcds_q77/datafusion:parquet 49020420 49770812 0.98
tpcds_q78/datafusion:parquet 120359255 121907882 0.99
tpcds_q79/datafusion:parquet 32225564 31199540 1.03
tpcds_q80/datafusion:parquet 92202751 93573239 0.99
tpcds_q81/datafusion:parquet 42102297 42186069 1.00
tpcds_q82/datafusion:parquet 23963855 23974362 1.00
tpcds_q83/datafusion:parquet 47428249 48569355 0.98
tpcds_q84/datafusion:parquet 48660492 47807423 1.02
tpcds_q85/datafusion:parquet 169977908 170436151 1.00
tpcds_q86/datafusion:parquet 🚨 18747190 16619694 1.13
tpcds_q87/datafusion:parquet 49913828 49991531 1.00
tpcds_q88/datafusion:parquet 69913632 69552954 1.01
tpcds_q89/datafusion:parquet 23954407 24338501 0.98
tpcds_q90/datafusion:parquet 17873814 18999365 0.94
tpcds_q91/datafusion:parquet 70637572 69766126 1.01
tpcds_q92/datafusion:parquet 20716236 22414105 0.92
tpcds_q93/datafusion:parquet 34591703 35491152 0.97
tpcds_q94/datafusion:parquet 26095329 23859436 1.09
tpcds_q95/datafusion:parquet 67158667 68001322 0.99
tpcds_q96/datafusion:parquet 14459012 13839754 1.04
tpcds_q97/datafusion:parquet 34803093 32708554 1.06
tpcds_q98/datafusion:parquet 25225714 25268312 1.00
tpcds_q99/datafusion:parquet 🚨 34080708 28992034 1.18
duckdb / vortex-file-compressed (1.031x ➖, 0↑ 11↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 24528013 25404677 0.97
tpcds_q02/duckdb:vortex-file-compressed 81072726 82281377 0.99
tpcds_q03/duckdb:vortex-file-compressed 25878697 24089553 1.07
tpcds_q04/duckdb:vortex-file-compressed 96869087 97010449 1.00
tpcds_q05/duckdb:vortex-file-compressed 92450723 97028372 0.95
tpcds_q06/duckdb:vortex-file-compressed 35552565 34705969 1.02
tpcds_q07/duckdb:vortex-file-compressed 22575610 23835796 0.95
tpcds_q08/duckdb:vortex-file-compressed 27396113 27376767 1.00
tpcds_q09/duckdb:vortex-file-compressed 🚨 43941199 34042049 1.29
tpcds_q10/duckdb:vortex-file-compressed 41821317 43981189 0.95
tpcds_q11/duckdb:vortex-file-compressed 62076586 59328645 1.05
tpcds_q12/duckdb:vortex-file-compressed 15226028 14482447 1.05
tpcds_q13/duckdb:vortex-file-compressed 41775768 42917345 0.97
tpcds_q14/duckdb:vortex-file-compressed 196240711 203985546 0.96
tpcds_q15/duckdb:vortex-file-compressed 40740870 40955944 0.99
tpcds_q16/duckdb:vortex-file-compressed 28815410 28505473 1.01
tpcds_q17/duckdb:vortex-file-compressed 37425060 36044481 1.04
tpcds_q18/duckdb:vortex-file-compressed 46437434 44384584 1.05
tpcds_q19/duckdb:vortex-file-compressed 33055782 32641160 1.01
tpcds_q20/duckdb:vortex-file-compressed 16392801 15175113 1.08
tpcds_q21/duckdb:vortex-file-compressed 21463878 19742784 1.09
tpcds_q22/duckdb:vortex-file-compressed 109225548 103398004 1.06
tpcds_q23/duckdb:vortex-file-compressed 152396355 146336521 1.04
tpcds_q24/duckdb:vortex-file-compressed 58056892 52998034 1.10
tpcds_q25/duckdb:vortex-file-compressed 37287098 36282379 1.03
tpcds_q26/duckdb:vortex-file-compressed 39338934 37522876 1.05
tpcds_q27/duckdb:vortex-file-compressed 87523037 86440437 1.01
tpcds_q28/duckdb:vortex-file-compressed 38251840 34932336 1.10
tpcds_q29/duckdb:vortex-file-compressed 33338498 35284838 0.94
tpcds_q30/duckdb:vortex-file-compressed 30720979 29568326 1.04
tpcds_q31/duckdb:vortex-file-compressed 29531733 29762942 0.99
tpcds_q32/duckdb:vortex-file-compressed 17060265 17925767 0.95
tpcds_q33/duckdb:vortex-file-compressed 66167959 61133640 1.08
tpcds_q34/duckdb:vortex-file-compressed 18781784 18313414 1.03
tpcds_q35/duckdb:vortex-file-compressed 71036791 70045099 1.01
tpcds_q36/duckdb:vortex-file-compressed 28311057 27332532 1.04
tpcds_q37/duckdb:vortex-file-compressed 🚨 26851996 21250117 1.26
tpcds_q38/duckdb:vortex-file-compressed 40711322 41725200 0.98
tpcds_q39/duckdb:vortex-file-compressed 48668125 44863649 1.08
tpcds_q40/duckdb:vortex-file-compressed 23213370 24640657 0.94
tpcds_q41/duckdb:vortex-file-compressed 13554985 13275742 1.02
tpcds_q42/duckdb:vortex-file-compressed 11452111 12112386 0.95
tpcds_q43/duckdb:vortex-file-compressed 31136388 31489370 0.99
tpcds_q44/duckdb:vortex-file-compressed 23974824 25930339 0.92
tpcds_q45/duckdb:vortex-file-compressed 🚨 30150247 25973422 1.16
tpcds_q46/duckdb:vortex-file-compressed 48042746 46496707 1.03
tpcds_q47/duckdb:vortex-file-compressed 49790690 50077129 0.99
tpcds_q48/duckdb:vortex-file-compressed 38727390 38218123 1.01
tpcds_q49/duckdb:vortex-file-compressed 🚨 36537200 29113306 1.26
tpcds_q50/duckdb:vortex-file-compressed 36004703 33293095 1.08
tpcds_q51/duckdb:vortex-file-compressed 99934543 99576973 1.00
tpcds_q52/duckdb:vortex-file-compressed 12407171 11861178 1.05
tpcds_q53/duckdb:vortex-file-compressed 16817316 16995791 0.99
tpcds_q54/duckdb:vortex-file-compressed 46638488 45303834 1.03
tpcds_q55/duckdb:vortex-file-compressed 12158368 11122766 1.09
tpcds_q56/duckdb:vortex-file-compressed 65048125 60910051 1.07
tpcds_q57/duckdb:vortex-file-compressed 44224643 43911771 1.01
tpcds_q58/duckdb:vortex-file-compressed 🚨 38167338 34528236 1.11
tpcds_q59/duckdb:vortex-file-compressed 75012352 80362729 0.93
tpcds_q60/duckdb:vortex-file-compressed 🚨 71662753 64729772 1.11
tpcds_q61/duckdb:vortex-file-compressed 39304733 36874970 1.07
tpcds_q62/duckdb:vortex-file-compressed 🚨 21506714 17759876 1.21
tpcds_q63/duckdb:vortex-file-compressed 17938984 16979331 1.06
tpcds_q64/duckdb:vortex-file-compressed 82227900 77343872 1.06
tpcds_q65/duckdb:vortex-file-compressed 24084133 23447866 1.03
tpcds_q66/duckdb:vortex-file-compressed 52941390 54343099 0.97
tpcds_q67/duckdb:vortex-file-compressed 146747644 143867483 1.02
tpcds_q68/duckdb:vortex-file-compressed 39708396 40740676 0.97
tpcds_q69/duckdb:vortex-file-compressed 43440636 42447606 1.02
tpcds_q70/duckdb:vortex-file-compressed 28502867 28446777 1.00
tpcds_q71/duckdb:vortex-file-compressed 20395637 21022440 0.97
tpcds_q72/duckdb:vortex-file-compressed 177524183 174040212 1.02
tpcds_q73/duckdb:vortex-file-compressed 18922614 19575234 0.97
tpcds_q74/duckdb:vortex-file-compressed 49873885 46409826 1.07
tpcds_q75/duckdb:vortex-file-compressed 60633390 61059639 0.99
tpcds_q76/duckdb:vortex-file-compressed 63764131 58567124 1.09
tpcds_q77/duckdb:vortex-file-compressed 🚨 66012746 59145438 1.12
tpcds_q78/duckdb:vortex-file-compressed 80682469 78530814 1.03
tpcds_q79/duckdb:vortex-file-compressed 38565159 35146004 1.10
tpcds_q80/duckdb:vortex-file-compressed 89173637 87092948 1.02
tpcds_q81/duckdb:vortex-file-compressed 32198658 33807901 0.95
tpcds_q82/duckdb:vortex-file-compressed 🚨 26285852 22529083 1.17
tpcds_q83/duckdb:vortex-file-compressed 29800158 28011030 1.06
tpcds_q84/duckdb:vortex-file-compressed 18231469 17387530 1.05
tpcds_q85/duckdb:vortex-file-compressed 46443593 45605631 1.02
tpcds_q86/duckdb:vortex-file-compressed 18655421 18305731 1.02
tpcds_q87/duckdb:vortex-file-compressed 45540544 44728373 1.02
tpcds_q88/duckdb:vortex-file-compressed 40578038 40202917 1.01
tpcds_q89/duckdb:vortex-file-compressed 17977237 18521662 0.97
tpcds_q90/duckdb:vortex-file-compressed 13927224 13709682 1.02
tpcds_q91/duckdb:vortex-file-compressed 29107887 28080972 1.04
tpcds_q92/duckdb:vortex-file-compressed 14261673 14883982 0.96
tpcds_q93/duckdb:vortex-file-compressed 🚨 30637472 27666732 1.11
tpcds_q94/duckdb:vortex-file-compressed 21642188 21021051 1.03
tpcds_q95/duckdb:vortex-file-compressed 🚨 158259608 141908303 1.12
tpcds_q96/duckdb:vortex-file-compressed 17180808 17068415 1.01
tpcds_q97/duckdb:vortex-file-compressed 38894290 38459799 1.01
tpcds_q98/duckdb:vortex-file-compressed 18447749 17730848 1.04
tpcds_q99/duckdb:vortex-file-compressed 31264998 34690175 0.90
duckdb / vortex-compact (1.008x ➖, 6↑ 4↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 33275075 32153654 1.03
tpcds_q02/duckdb:vortex-compact 114338329 114707248 1.00
tpcds_q03/duckdb:vortex-compact 50823845 50818228 1.00
tpcds_q04/duckdb:vortex-compact 119747024 120126654 1.00
tpcds_q05/duckdb:vortex-compact 152551068 154581279 0.99
tpcds_q06/duckdb:vortex-compact 41833061 40409165 1.04
tpcds_q07/duckdb:vortex-compact 39557565 38006246 1.04
tpcds_q08/duckdb:vortex-compact 35081077 35490258 0.99
tpcds_q09/duckdb:vortex-compact 🚨 67188216 57336651 1.17
tpcds_q10/duckdb:vortex-compact 53801417 55550013 0.97
tpcds_q11/duckdb:vortex-compact 74334779 72892172 1.02
tpcds_q12/duckdb:vortex-compact 🚨 21095438 18876249 1.12
tpcds_q13/duckdb:vortex-compact 72269293 69173249 1.04
tpcds_q14/duckdb:vortex-compact 285563081 278574753 1.03
tpcds_q15/duckdb:vortex-compact 45870048 44125013 1.04
tpcds_q16/duckdb:vortex-compact 35576980 33239299 1.07
tpcds_q17/duckdb:vortex-compact 50467640 49541343 1.02
tpcds_q18/duckdb:vortex-compact 60681282 56818310 1.07
tpcds_q19/duckdb:vortex-compact 42692743 41357673 1.03
tpcds_q20/duckdb:vortex-compact 19769753 19554327 1.01
tpcds_q21/duckdb:vortex-compact 27262080 28572681 0.95
tpcds_q22/duckdb:vortex-compact 119623595 113047444 1.06
tpcds_q23/duckdb:vortex-compact 164536696 164204989 1.00
tpcds_q24/duckdb:vortex-compact 77260405 76618645 1.01
tpcds_q25/duckdb:vortex-compact 52300010 51384401 1.02
tpcds_q26/duckdb:vortex-compact 48390290 52048536 0.93
tpcds_q27/duckdb:vortex-compact 142316924 142660023 1.00
tpcds_q28/duckdb:vortex-compact 86201043 86564659 1.00
tpcds_q29/duckdb:vortex-compact 49315178 50332474 0.98
tpcds_q30/duckdb:vortex-compact 34497786 33555433 1.03
tpcds_q31/duckdb:vortex-compact 36725503 35457797 1.04
tpcds_q32/duckdb:vortex-compact 23958101 22283325 1.08
tpcds_q33/duckdb:vortex-compact 138471361 135083715 1.03
tpcds_q34/duckdb:vortex-compact 30527075 30354623 1.01
tpcds_q35/duckdb:vortex-compact 76578447 78513827 0.98
tpcds_q36/duckdb:vortex-compact 36688554 34858289 1.05
tpcds_q37/duckdb:vortex-compact 33853365 31362394 1.08
tpcds_q38/duckdb:vortex-compact 🚀 41380403 46947247 0.88
tpcds_q39/duckdb:vortex-compact 54543204 51822357 1.05
tpcds_q40/duckdb:vortex-compact 28301429 28106092 1.01
tpcds_q41/duckdb:vortex-compact 16331017 16149986 1.01
tpcds_q42/duckdb:vortex-compact 17694626 16788261 1.05
tpcds_q43/duckdb:vortex-compact 39077401 38227965 1.02
tpcds_q44/duckdb:vortex-compact 35398617 35611507 0.99
tpcds_q45/duckdb:vortex-compact 33496683 31196945 1.07
tpcds_q46/duckdb:vortex-compact 63903826 63303197 1.01
tpcds_q47/duckdb:vortex-compact 57238604 57230818 1.00
tpcds_q48/duckdb:vortex-compact 57923167 56539585 1.02
tpcds_q49/duckdb:vortex-compact 🚨 49480130 43057288 1.15
tpcds_q50/duckdb:vortex-compact 57347786 57509399 1.00
tpcds_q51/duckdb:vortex-compact 103576668 104605725 0.99
tpcds_q52/duckdb:vortex-compact 17204667 16926573 1.02
tpcds_q53/duckdb:vortex-compact 25182502 24234879 1.04
tpcds_q54/duckdb:vortex-compact 79616057 79846935 1.00
tpcds_q55/duckdb:vortex-compact 17514141 17264268 1.01
tpcds_q56/duckdb:vortex-compact 134028663 137699340 0.97
tpcds_q57/duckdb:vortex-compact 48056981 48151889 1.00
tpcds_q58/duckdb:vortex-compact 45338330 45575168 0.99
tpcds_q59/duckdb:vortex-compact 🚀 85339173 103003389 0.83
tpcds_q60/duckdb:vortex-compact 137198205 142063337 0.97
tpcds_q61/duckdb:vortex-compact 57855777 56720088 1.02
tpcds_q62/duckdb:vortex-compact 🚨 27203505 20749875 1.31
tpcds_q63/duckdb:vortex-compact 24627077 24850896 0.99
tpcds_q64/duckdb:vortex-compact 113735846 107357370 1.06
tpcds_q65/duckdb:vortex-compact 29937876 30166917 0.99
tpcds_q66/duckdb:vortex-compact 93570419 92833361 1.01
tpcds_q67/duckdb:vortex-compact 154149859 149499845 1.03
tpcds_q68/duckdb:vortex-compact 58971029 57360716 1.03
tpcds_q69/duckdb:vortex-compact 57047445 53340968 1.07
tpcds_q70/duckdb:vortex-compact 35522833 35783305 0.99
tpcds_q71/duckdb:vortex-compact 27086760 28051218 0.97
tpcds_q72/duckdb:vortex-compact 193280413 195338419 0.99
tpcds_q73/duckdb:vortex-compact 30688861 30434723 1.01
tpcds_q74/duckdb:vortex-compact 57072183 55480386 1.03
tpcds_q75/duckdb:vortex-compact 66819992 67910058 0.98
tpcds_q76/duckdb:vortex-compact 141153301 132364228 1.07
tpcds_q77/duckdb:vortex-compact 128487714 133861192 0.96
tpcds_q78/duckdb:vortex-compact 86782611 86912909 1.00
tpcds_q79/duckdb:vortex-compact 66599519 67682186 0.98
tpcds_q80/duckdb:vortex-compact 166149655 169134027 0.98
tpcds_q81/duckdb:vortex-compact 🚀 39257026 44003468 0.89
tpcds_q82/duckdb:vortex-compact 33834586 32543223 1.04
tpcds_q83/duckdb:vortex-compact 47753117 46391670 1.03
tpcds_q84/duckdb:vortex-compact 22166896 22335967 0.99
tpcds_q85/duckdb:vortex-compact 61106346 62704307 0.97
tpcds_q86/duckdb:vortex-compact 21961870 20546933 1.07
tpcds_q87/duckdb:vortex-compact 51897754 48956558 1.06
tpcds_q88/duckdb:vortex-compact 43955019 44670209 0.98
tpcds_q89/duckdb:vortex-compact 25696520 24607477 1.04
tpcds_q90/duckdb:vortex-compact 🚀 13964395 15796894 0.88
tpcds_q91/duckdb:vortex-compact 46835361 46848605 1.00
tpcds_q92/duckdb:vortex-compact 20697647 21978273 0.94
tpcds_q93/duckdb:vortex-compact 🚀 35147350 39485698 0.89
tpcds_q94/duckdb:vortex-compact 🚀 25408557 29558860 0.86
tpcds_q95/duckdb:vortex-compact 143100721 158972671 0.90
tpcds_q96/duckdb:vortex-compact 18422293 18585127 0.99
tpcds_q97/duckdb:vortex-compact 43285629 44444321 0.97
tpcds_q98/duckdb:vortex-compact 24470586 24794520 0.99
tpcds_q99/duckdb:vortex-compact 34611014 33185903 1.04
duckdb / parquet (0.997x ➖, 0↑ 1↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 44449490 45457040 0.98
tpcds_q02/duckdb:parquet 60179060 59514932 1.01
tpcds_q03/duckdb:parquet 11709190 12166848 0.96
tpcds_q04/duckdb:parquet 124461537 124444884 1.00
tpcds_q05/duckdb:parquet 74090241 75431103 0.98
tpcds_q06/duckdb:parquet 28642999 28801718 0.99
tpcds_q07/duckdb:parquet 22790796 22961374 0.99
tpcds_q08/duckdb:parquet 28962888 27605949 1.05
tpcds_q09/duckdb:parquet 39621995 39613943 1.00
tpcds_q10/duckdb:parquet 33367463 35714797 0.93
tpcds_q11/duckdb:parquet 85902099 87575184 0.98
tpcds_q12/duckdb:parquet 14207531 14721516 0.97
tpcds_q13/duckdb:parquet 34210372 34098855 1.00
tpcds_q14/duckdb:parquet 166626206 160146295 1.04
tpcds_q15/duckdb:parquet 28540683 29229123 0.98
tpcds_q16/duckdb:parquet 21143315 21089842 1.00
tpcds_q17/duckdb:parquet 35194701 38825454 0.91
tpcds_q18/duckdb:parquet 44048594 45884779 0.96
tpcds_q19/duckdb:parquet 28903823 28422711 1.02
tpcds_q20/duckdb:parquet 15315835 15192583 1.01
tpcds_q21/duckdb:parquet 11173532 10881744 1.03
tpcds_q22/duckdb:parquet 67264134 66522194 1.01
tpcds_q23/duckdb:parquet 115399371 116285690 0.99
tpcds_q24/duckdb:parquet 45845490 45333133 1.01
tpcds_q25/duckdb:parquet 32234772 32947332 0.98
tpcds_q26/duckdb:parquet 35302557 38040725 0.93
tpcds_q27/duckdb:parquet 88374572 88552500 1.00
tpcds_q28/duckdb:parquet 37170262 36778651 1.01
tpcds_q29/duckdb:parquet 35504761 36212898 0.98
tpcds_q30/duckdb:parquet 38637537 39941350 0.97
tpcds_q31/duckdb:parquet 22761686 23907617 0.95
tpcds_q32/duckdb:parquet 11015762 10897187 1.01
tpcds_q33/duckdb:parquet 71458046 70198508 1.02
tpcds_q34/duckdb:parquet 22559034 20752687 1.09
tpcds_q35/duckdb:parquet 60127938 61286638 0.98
tpcds_q36/duckdb:parquet 21009350 20781522 1.01
tpcds_q37/duckdb:parquet 13297709 13428652 0.99
tpcds_q38/duckdb:parquet 33756598 33988688 0.99
tpcds_q39/duckdb:parquet 32502644 32231061 1.01
tpcds_q40/duckdb:parquet 17707358 18221941 0.97
tpcds_q41/duckdb:parquet 7396043 7509242 0.98
tpcds_q42/duckdb:parquet 10000083 10258804 0.97
tpcds_q43/duckdb:parquet 15570106 15323068 1.02
tpcds_q44/duckdb:parquet 21593169 21422018 1.01
tpcds_q45/duckdb:parquet 25888919 25922763 1.00
tpcds_q46/duckdb:parquet 44333961 45215530 0.98
tpcds_q47/duckdb:parquet 45163722 45490150 0.99
tpcds_q48/duckdb:parquet 30181131 31035080 0.97
tpcds_q49/duckdb:parquet 23923457 24250160 0.99
tpcds_q50/duckdb:parquet 24569258 24444418 1.01
tpcds_q51/duckdb:parquet 95884384 96448696 0.99
tpcds_q52/duckdb:parquet 10787536 10731221 1.01
tpcds_q53/duckdb:parquet 16210048 16095646 1.01
tpcds_q54/duckdb:parquet 41441016 40888795 1.01
tpcds_q55/duckdb:parquet 10452081 10099977 1.03
tpcds_q56/duckdb:parquet 68483225 65677631 1.04
tpcds_q57/duckdb:parquet 35104293 35124717 1.00
tpcds_q58/duckdb:parquet 21055826 20966890 1.00
tpcds_q59/duckdb:parquet 36506883 36972314 0.99
tpcds_q60/duckdb:parquet 71238572 70769098 1.01
tpcds_q61/duckdb:parquet 31035896 31553861 0.98
tpcds_q62/duckdb:parquet 11703019 11503901 1.02
tpcds_q63/duckdb:parquet 15169260 15202218 1.00
tpcds_q64/duckdb:parquet 76628710 73739451 1.04
tpcds_q65/duckdb:parquet 19762956 20293446 0.97
tpcds_q66/duckdb:parquet 🚨 59793624 53831390 1.11
tpcds_q67/duckdb:parquet 131742074 134195085 0.98
tpcds_q68/duckdb:parquet 37149988 38045951 0.98
tpcds_q69/duckdb:parquet 37777835 37150502 1.02
tpcds_q70/duckdb:parquet 19577971 19588399 1.00
tpcds_q71/duckdb:parquet 18442386 17585544 1.05
tpcds_q72/duckdb:parquet 164948370 163909200 1.01
tpcds_q73/duckdb:parquet 18622395 17792149 1.05
tpcds_q74/duckdb:parquet 49149696 48634383 1.01
tpcds_q75/duckdb:parquet 53528829 52696489 1.02
tpcds_q76/duckdb:parquet 70378104 72200181 0.97
tpcds_q77/duckdb:parquet 60945262 63250618 0.96
tpcds_q78/duckdb:parquet 74017834 70449967 1.05
tpcds_q79/duckdb:parquet 27738070 26942452 1.03
tpcds_q80/duckdb:parquet 85680876 81241604 1.05
tpcds_q81/duckdb:parquet 46535742 47772441 0.97
tpcds_q82/duckdb:parquet 15600076 15607777 1.00
tpcds_q83/duckdb:parquet 16235224 16230499 1.00
tpcds_q84/duckdb:parquet 19217122 19867364 0.97
tpcds_q85/duckdb:parquet 39454958 40098195 0.98
tpcds_q86/duckdb:parquet 12478235 12486577 1.00
tpcds_q87/duckdb:parquet 37827328 37282169 1.01
tpcds_q88/duckdb:parquet 29108063 29250803 1.00
tpcds_q89/duckdb:parquet 17241790 17366409 0.99
tpcds_q90/duckdb:parquet 8078036 8110905 1.00
tpcds_q91/duckdb:parquet 23547952 23261292 1.01
tpcds_q92/duckdb:parquet 11069955 11162014 0.99
tpcds_q93/duckdb:parquet 29798477 29210014 1.02
tpcds_q94/duckdb:parquet 16680091 16681241 1.00
tpcds_q95/duckdb:parquet 131436599 145341051 0.90
tpcds_q96/duckdb:parquet 9013890 9330806 0.97
tpcds_q97/duckdb:parquet 34881739 35599083 0.98
tpcds_q98/duckdb:parquet 17928070 18002703 1.00
tpcds_q99/duckdb:parquet 19894404 20083860 0.99
duckdb / duckdb (0.963x ➖, 7↑ 2↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 19611755 20023551 0.98
tpcds_q02/duckdb:duckdb 18525304 17486574 1.06
tpcds_q03/duckdb:duckdb 8020056 8787348 0.91
tpcds_q04/duckdb:duckdb 160974990 162184859 0.99
tpcds_q05/duckdb:duckdb 17656463 18951238 0.93
tpcds_q06/duckdb:duckdb 21520331 23615360 0.91
tpcds_q07/duckdb:duckdb 38797764 42265456 0.92
tpcds_q08/duckdb:duckdb 119606588 121139793 0.99
tpcds_q09/duckdb:duckdb 19582150 19647445 1.00
tpcds_q10/duckdb:duckdb 22597624 23462560 0.96
tpcds_q11/duckdb:duckdb 138985467 139307929 1.00
tpcds_q12/duckdb:duckdb 11146291 11603241 0.96
tpcds_q13/duckdb:duckdb 23142373 24074053 0.96
tpcds_q14/duckdb:duckdb 88774864 93432171 0.95
tpcds_q15/duckdb:duckdb 24120475 26038866 0.93
tpcds_q16/duckdb:duckdb 🚀 16475612 18486757 0.89
tpcds_q17/duckdb:duckdb 20615847 21689816 0.95
tpcds_q18/duckdb:duckdb 42377000 45296245 0.94
tpcds_q19/duckdb:duckdb 16083059 16489150 0.98
tpcds_q20/duckdb:duckdb 11820406 12000817 0.98
tpcds_q21/duckdb:duckdb 6721538 6608405 1.02
tpcds_q22/duckdb:duckdb 60069811 61750385 0.97
tpcds_q23/duckdb:duckdb 🚨 79438858 71515596 1.11
tpcds_q24/duckdb:duckdb 25017225 23553033 1.06
tpcds_q25/duckdb:duckdb 16705964 16596784 1.01
tpcds_q26/duckdb:duckdb 24991781 26845473 0.93
tpcds_q27/duckdb:duckdb 🚀 39334458 44125616 0.89
tpcds_q28/duckdb:duckdb 21029259 22622266 0.93
tpcds_q29/duckdb:duckdb 19861498 20647383 0.96
tpcds_q30/duckdb:duckdb 28553838 28001965 1.02
tpcds_q31/duckdb:duckdb 20578420 21121492 0.97
tpcds_q32/duckdb:duckdb 6800238 7208803 0.94
tpcds_q33/duckdb:duckdb 12685579 12932942 0.98
tpcds_q34/duckdb:duckdb 16145151 15076175 1.07
tpcds_q35/duckdb:duckdb 32126254 32980259 0.97
tpcds_q36/duckdb:duckdb 69306201 70647048 0.98
tpcds_q37/duckdb:duckdb 7546322 7699809 0.98
tpcds_q38/duckdb:duckdb 31858106 30919883 1.03
tpcds_q39/duckdb:duckdb 25442828 27061972 0.94
tpcds_q40/duckdb:duckdb 🚀 13579734 16402604 0.83
tpcds_q41/duckdb:duckdb 🚀 7981545 9648223 0.83
tpcds_q42/duckdb:duckdb 6218354 6786613 0.92
tpcds_q43/duckdb:duckdb 11762918 11767714 1.00
tpcds_q44/duckdb:duckdb 12761897 13816257 0.92
tpcds_q45/duckdb:duckdb 17648825 18155836 0.97
tpcds_q46/duckdb:duckdb 37409728 38123724 0.98
tpcds_q47/duckdb:duckdb 40410401 42039488 0.96
tpcds_q48/duckdb:duckdb 21376351 23131154 0.92
tpcds_q49/duckdb:duckdb 15420132 16609671 0.93
tpcds_q50/duckdb:duckdb 13756067 14249749 0.97
tpcds_q51/duckdb:duckdb 90121881 92149318 0.98
tpcds_q52/duckdb:duckdb 7233256 7761776 0.93
tpcds_q53/duckdb:duckdb 11525347 12181916 0.95
tpcds_q54/duckdb:duckdb 16181553 16920347 0.96
tpcds_q55/duckdb:duckdb 6618574 7246143 0.91
tpcds_q56/duckdb:duckdb 13779230 13645827 1.01
tpcds_q57/duckdb:duckdb 31490770 31977690 0.98
tpcds_q58/duckdb:duckdb 11358991 12451754 0.91
tpcds_q59/duckdb:duckdb 34053999 35504554 0.96
tpcds_q60/duckdb:duckdb 14891921 14791172 1.01
tpcds_q61/duckdb:duckdb 14117739 13904517 1.02
tpcds_q62/duckdb:duckdb 8840357 9285036 0.95
tpcds_q63/duckdb:duckdb 10934324 11218988 0.97
tpcds_q64/duckdb:duckdb 52733888 55829175 0.94
tpcds_q65/duckdb:duckdb 34597703 34417522 1.01
tpcds_q66/duckdb:duckdb 25085914 24540635 1.02
tpcds_q67/duckdb:duckdb 125820595 135563968 0.93
tpcds_q68/duckdb:duckdb 25919712 25638360 1.01
tpcds_q69/duckdb:duckdb 24155148 24093767 1.00
tpcds_q70/duckdb:duckdb 14866267 15190734 0.98
tpcds_q71/duckdb:duckdb 12118545 13180021 0.92
tpcds_q72/duckdb:duckdb 41013239 40718253 1.01
tpcds_q73/duckdb:duckdb 10564940 10750787 0.98
tpcds_q74/duckdb:duckdb 98921522 98312907 1.01
tpcds_q75/duckdb:duckdb 41349882 42608101 0.97
tpcds_q76/duckdb:duckdb 11393655 12275715 0.93
tpcds_q77/duckdb:duckdb 11392898 11955493 0.95
tpcds_q78/duckdb:duckdb 62990236 68392692 0.92
tpcds_q79/duckdb:duckdb 18632511 19316031 0.96
tpcds_q80/duckdb:duckdb 27843711 29588835 0.94
tpcds_q81/duckdb:duckdb 35646554 38791888 0.92
tpcds_q82/duckdb:duckdb 8096826 8266654 0.98
tpcds_q83/duckdb:duckdb 8779130 9356852 0.94
tpcds_q84/duckdb:duckdb 🚨 15217198 13178756 1.15
tpcds_q85/duckdb:duckdb 23659425 24103080 0.98
tpcds_q86/duckdb:duckdb 10177845 11071136 0.92
tpcds_q87/duckdb:duckdb 33847295 32992128 1.03
tpcds_q88/duckdb:duckdb 23890321 24456824 0.98
tpcds_q89/duckdb:duckdb 12677450 12877916 0.98
tpcds_q90/duckdb:duckdb 🚀 5241859 5864998 0.89
tpcds_q91/duckdb:duckdb 12669381 12948321 0.98
tpcds_q92/duckdb:duckdb 🚀 8560442 9775000 0.88
tpcds_q93/duckdb:duckdb 20150597 21638962 0.93
tpcds_q94/duckdb:duckdb 12208050 13010821 0.94
tpcds_q95/duckdb:duckdb 🚀 112258823 136533139 0.82
tpcds_q96/duckdb:duckdb 4397168 4675052 0.94
tpcds_q97/duckdb:duckdb 29641868 30887356 0.96
tpcds_q98/duckdb:duckdb 12957498 13502454 0.96
tpcds_q99/duckdb:duckdb 16726449 16150927 1.04
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -2.0% -4.4% +2.6% +11.4% ➖ noise
1 datafusion:vortex-file-compressed -6.3% -4.4% -2.0% +12.3% ➖ noise
1 duckdb:duckdb -2.1% -4.4% +2.5% +12.3% ➖ noise
1 duckdb:vortex-compact +3.5% -4.4% +8.3% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -3.5% -4.4% +1.0% +12.5% ➖ noise
2 datafusion:vortex-compact +0.6% +1.2% -0.6% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +4.6% +1.2% +3.4% +10.0% ➖ noise
2 duckdb:duckdb +5.9% +1.2% +4.7% +12.0% ➖ noise
2 duckdb:vortex-compact -0.3% +1.2% -1.5% +11.4% ➖ noise
2 duckdb:vortex-file-compressed -1.5% +1.2% -2.6% +13.2% ➖ noise
3 datafusion:vortex-compact -1.3% -6.0% +5.0% +14.0% ➖ noise
3 datafusion:vortex-file-compressed +3.3% -6.0% +9.9% +15.5% ➖ noise
3 duckdb:duckdb -8.7% -6.0% -2.9% +20.2% ➖ noise
3 duckdb:vortex-compact +0.0% -6.0% +6.4% +11.3% ➖ noise
3 duckdb:vortex-file-compressed +7.4% -6.0% +14.3% +14.3% ➖ noise
4 datafusion:vortex-compact +0.1% -0.8% +0.9% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -0.6% -0.8% +0.2% +10.0% ➖ noise
4 duckdb:duckdb -0.7% -0.8% +0.0% +10.0% ➖ noise
4 duckdb:vortex-compact -0.3% -0.8% +0.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.1% -0.8% +0.6% +10.3% ➖ noise
5 datafusion:vortex-compact -2.3% -0.5% -1.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -6.4% -0.5% -6.0% +10.0% ➖ noise
5 duckdb:duckdb -6.8% -0.5% -6.4% +15.6% ➖ noise
5 duckdb:vortex-compact -1.3% -0.5% -0.9% +10.2% ➖ noise
5 duckdb:vortex-file-compressed -4.7% -0.5% -4.3% +11.4% ➖ noise
6 datafusion:vortex-compact -1.2% -0.6% -0.6% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -0.5% -0.6% +0.1% +10.0% ➖ noise
6 duckdb:duckdb -8.9% -0.6% -8.3% +19.8% ➖ noise
6 duckdb:vortex-compact +3.5% -0.6% +4.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +2.4% -0.6% +3.1% +10.0% ➖ noise
7 datafusion:vortex-compact +1.7% +0.2% +1.5% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +2.2% +0.2% +1.9% +10.0% ➖ noise
7 duckdb:duckdb -8.2% +0.2% -8.4% +17.7% ➖ noise
7 duckdb:vortex-compact +4.1% +0.2% +3.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -5.3% +0.2% -5.5% +10.0% ➖ noise
8 datafusion:vortex-compact +0.6% +3.9% -3.3% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -6.6% +3.9% -10.2% +10.3% ✅ faster
8 duckdb:duckdb -1.3% +3.9% -5.0% +10.0% ➖ noise
8 duckdb:vortex-compact -1.2% +3.9% -4.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.1% +3.9% -3.7% +15.5% ➖ noise
9 datafusion:vortex-compact +11.0% +1.6% +9.3% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +13.3% +1.6% +11.5% +10.0% 🚨 regression
9 duckdb:duckdb -0.3% +1.6% -1.9% +10.0% ➖ noise
9 duckdb:vortex-compact +17.2% +1.6% +15.4% +10.0% 🚨 regression
9 duckdb:vortex-file-compressed +29.1% +1.6% +27.1% +10.0% 🚨 regression
10 datafusion:vortex-compact +2.9% -2.6% +5.6% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -3.3% -2.6% -0.7% +10.0% ➖ noise
10 duckdb:duckdb -3.7% -2.6% -1.1% +10.0% ➖ noise
10 duckdb:vortex-compact -3.1% -2.6% -0.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -4.9% -2.6% -2.4% +10.0% ➖ noise
11 datafusion:vortex-compact +1.6% -2.8% +4.5% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -2.8% -2.8% +0.0% +10.0% ➖ noise
11 duckdb:duckdb -0.2% -2.8% +2.6% +10.0% ➖ noise
11 duckdb:vortex-compact +2.0% -2.8% +4.9% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +4.6% -2.8% +7.6% +10.0% ➖ noise
12 datafusion:vortex-compact -2.9% -2.4% -0.6% +12.4% ➖ noise
12 datafusion:vortex-file-compressed +1.2% -2.4% +3.7% +11.1% ➖ noise
12 duckdb:duckdb -3.9% -2.4% -1.6% +12.7% ➖ noise
12 duckdb:vortex-compact +11.8% -2.4% +14.5% +16.7% ➖ noise
12 duckdb:vortex-file-compressed +5.1% -2.4% +7.7% +10.6% ➖ noise
13 datafusion:vortex-compact +8.0% -0.3% +8.3% +11.2% ➖ noise
13 datafusion:vortex-file-compressed +0.4% -0.3% +0.7% +10.0% ➖ noise
13 duckdb:duckdb -3.9% -0.3% -3.6% +10.0% ➖ noise
13 duckdb:vortex-compact +4.5% -0.3% +4.8% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -2.7% -0.3% -2.4% +10.0% ➖ noise
14 datafusion:vortex-compact -1.2% +0.3% -1.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -2.8% +0.3% -3.1% +10.0% ➖ noise
14 duckdb:duckdb -5.0% +0.3% -5.3% +10.6% ➖ noise
14 duckdb:vortex-compact +2.5% +0.3% +2.2% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -3.8% +0.3% -4.1% +10.0% ➖ noise
15 datafusion:vortex-compact -5.0% -5.9% +0.9% +12.7% ➖ noise
15 datafusion:vortex-file-compressed -1.8% -5.9% +4.4% +14.8% ➖ noise
15 duckdb:duckdb -7.4% -5.9% -1.6% +17.0% ➖ noise
15 duckdb:vortex-compact +4.0% -5.9% +10.4% +11.2% ➖ noise
15 duckdb:vortex-file-compressed -0.5% -5.9% +5.7% +10.8% ➖ noise
16 datafusion:vortex-compact +0.5% -1.9% +2.4% +10.3% ➖ noise
16 datafusion:vortex-file-compressed -2.1% -1.9% -0.2% +10.0% ➖ noise
16 duckdb:duckdb -10.9% -1.9% -9.2% +10.8% ➖ noise
16 duckdb:vortex-compact +7.0% -1.9% +9.1% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +1.1% -1.9% +3.0% +10.0% ➖ noise
17 datafusion:vortex-compact +4.3% -6.5% +11.5% +10.0% 🚨 regression
17 datafusion:vortex-file-compressed -3.4% -6.5% +3.3% +10.0% ➖ noise
17 duckdb:duckdb -5.0% -6.5% +1.6% +10.1% ➖ noise
17 duckdb:vortex-compact +1.9% -6.5% +8.9% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +3.8% -6.5% +11.0% +10.0% 🚨 regression
18 datafusion:vortex-compact +2.7% -1.9% +4.7% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -0.2% -1.9% +1.8% +10.0% ➖ noise
18 duckdb:duckdb -6.4% -1.9% -4.6% +10.0% ➖ noise
18 duckdb:vortex-compact +6.8% -1.9% +8.9% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +4.6% -1.9% +6.7% +10.0% ➖ noise
19 datafusion:vortex-compact +0.8% +0.2% +0.6% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -2.0% +0.2% -2.2% +10.0% ➖ noise
19 duckdb:duckdb -2.5% +0.2% -2.6% +10.0% ➖ noise
19 duckdb:vortex-compact +3.2% +0.2% +3.1% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +1.3% +0.2% +1.1% +10.0% ➖ noise
20 datafusion:vortex-compact -2.9% -1.3% -1.6% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -4.0% -1.3% -2.7% +10.0% ➖ noise
20 duckdb:duckdb -1.5% -1.3% -0.2% +11.2% ➖ noise
20 duckdb:vortex-compact +1.1% -1.3% +2.5% +12.2% ➖ noise
20 duckdb:vortex-file-compressed +8.0% -1.3% +9.5% +12.0% ➖ noise
21 datafusion:vortex-compact -2.9% -0.2% -2.8% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -1.7% -0.2% -1.5% +10.0% ➖ noise
21 duckdb:duckdb +1.7% -0.2% +1.9% +15.8% ➖ noise
21 duckdb:vortex-compact -4.6% -0.2% -4.4% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +8.7% -0.2% +8.9% +12.4% ➖ noise
22 datafusion:vortex-compact -5.1% -2.0% -3.1% +11.8% ➖ noise
22 datafusion:vortex-file-compressed +0.6% -2.0% +2.6% +10.6% ➖ noise
22 duckdb:duckdb -2.7% -2.0% -0.7% +11.6% ➖ noise
22 duckdb:vortex-compact +5.8% -2.0% +8.0% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +5.6% -2.0% +7.8% +10.0% ➖ noise
23 datafusion:vortex-compact -0.0% -0.4% +0.4% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -1.4% -0.4% -1.0% +10.0% ➖ noise
23 duckdb:duckdb +11.1% -0.4% +11.5% +15.8% ➖ noise
23 duckdb:vortex-compact +0.2% -0.4% +0.6% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +4.1% -0.4% +4.6% +10.0% ➖ noise
24 datafusion:vortex-compact +0.7% -0.3% +0.9% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -3.9% -0.3% -3.7% +10.0% ➖ noise
24 duckdb:duckdb +6.2% -0.3% +6.5% +10.0% ➖ noise
24 duckdb:vortex-compact +0.8% -0.3% +1.1% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +9.5% -0.3% +9.8% +10.8% ➖ noise
25 datafusion:vortex-compact -1.0% -3.7% +2.9% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -1.1% -3.7% +2.7% +10.0% ➖ noise
25 duckdb:duckdb +0.7% -3.7% +4.6% +13.3% ➖ noise
25 duckdb:vortex-compact +1.8% -3.7% +5.7% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +2.8% -3.7% +6.8% +10.0% ➖ noise
26 datafusion:vortex-compact +2.5% -3.2% +5.9% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -0.8% -3.2% +2.5% +10.0% ➖ noise
26 duckdb:duckdb -6.9% -3.2% -3.8% +13.2% ➖ noise
26 duckdb:vortex-compact -7.0% -3.2% -3.9% +13.3% ➖ noise
26 duckdb:vortex-file-compressed +4.8% -3.2% +8.3% +11.0% ➖ noise
27 datafusion:vortex-compact +0.3% +0.0% +0.3% +10.0% ➖ noise
27 datafusion:vortex-file-compressed +0.4% +0.0% +0.4% +10.0% ➖ noise
27 duckdb:duckdb -10.9% +0.0% -10.9% +15.7% ➖ noise
27 duckdb:vortex-compact -0.2% +0.0% -0.3% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +1.3% +0.0% +1.2% +10.0% ➖ noise
28 datafusion:vortex-compact +0.5% +0.5% -0.0% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +1.2% +0.5% +0.7% +10.0% ➖ noise
28 duckdb:duckdb -7.0% +0.5% -7.5% +10.0% ➖ noise
28 duckdb:vortex-compact -0.4% +0.5% -0.9% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +9.5% +0.5% +9.0% +10.0% ➖ noise
29 datafusion:vortex-compact -0.7% +0.6% -1.3% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -3.8% +0.6% -4.4% +10.0% ➖ noise
29 duckdb:duckdb -3.8% +0.6% -4.4% +10.3% ➖ noise
29 duckdb:vortex-compact -2.0% +0.6% -2.6% +10.9% ➖ noise
29 duckdb:vortex-file-compressed -5.5% +0.6% -6.1% +10.4% ➖ noise
30 datafusion:vortex-compact -1.3% -3.9% +2.7% +13.5% ➖ noise
30 datafusion:vortex-file-compressed -0.8% -3.9% +3.2% +10.6% ➖ noise
30 duckdb:duckdb +2.0% -3.9% +6.1% +10.4% ➖ noise
30 duckdb:vortex-compact +2.8% -3.9% +6.9% +13.2% ➖ noise
30 duckdb:vortex-file-compressed +3.9% -3.9% +8.1% +10.2% ➖ noise
31 datafusion:vortex-compact +1.4% -3.7% +5.4% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +2.1% -3.7% +6.1% +10.0% ➖ noise
31 duckdb:duckdb -2.6% -3.7% +1.2% +14.3% ➖ noise
31 duckdb:vortex-compact +3.6% -3.7% +7.6% +11.0% ➖ noise
31 duckdb:vortex-file-compressed -0.8% -3.7% +3.1% +10.9% ➖ noise
32 datafusion:vortex-compact -1.9% +0.6% -2.5% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -9.0% +0.6% -9.6% +10.0% ✅ faster
32 duckdb:duckdb -5.7% +0.6% -6.2% +12.6% ➖ noise
32 duckdb:vortex-compact +7.5% +0.6% +6.9% +11.0% ➖ noise
32 duckdb:vortex-file-compressed -4.8% +0.6% -5.4% +10.5% ➖ noise
33 datafusion:vortex-compact -1.5% +0.1% -1.6% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +0.2% +0.1% +0.1% +10.0% ➖ noise
33 duckdb:duckdb -1.9% +0.1% -2.0% +10.0% ➖ noise
33 duckdb:vortex-compact +2.5% +0.1% +2.4% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +8.2% +0.1% +8.1% +15.4% ➖ noise
34 datafusion:vortex-compact -0.1% +5.0% -4.8% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -0.4% +5.0% -5.2% +10.0% ➖ noise
34 duckdb:duckdb +7.1% +5.0% +2.0% +11.6% ➖ noise
34 duckdb:vortex-compact +0.6% +5.0% -4.2% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +2.6% +5.0% -2.3% +13.9% ➖ noise
35 datafusion:vortex-compact +3.0% -1.1% +4.2% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -5.5% -1.1% -4.4% +10.0% ➖ noise
35 duckdb:duckdb -2.6% -1.1% -1.5% +17.0% ➖ noise
35 duckdb:vortex-compact -2.5% -1.1% -1.4% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +1.4% -1.1% +2.6% +10.0% ➖ noise
36 datafusion:vortex-compact -1.0% +0.6% -1.6% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +2.6% +0.6% +2.0% +10.0% ➖ noise
36 duckdb:duckdb -1.9% +0.6% -2.5% +12.5% ➖ noise
36 duckdb:vortex-compact +5.3% +0.6% +4.6% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +3.6% +0.6% +2.9% +13.7% ➖ noise
37 datafusion:vortex-compact +11.5% +0.8% +10.6% +10.5% 🚨 regression
37 datafusion:vortex-file-compressed +20.9% +0.8% +19.9% +10.0% 🚨 regression
37 duckdb:duckdb -2.0% +0.8% -2.8% +15.1% ➖ noise
37 duckdb:vortex-compact +7.9% +0.8% +7.0% +18.0% ➖ noise
37 duckdb:vortex-file-compressed +26.4% +0.8% +25.3% +14.5% 🚨 regression
38 datafusion:vortex-compact -1.9% -0.2% -1.8% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -2.6% -0.2% -2.4% +10.0% ➖ noise
38 duckdb:duckdb +3.0% -0.2% +3.2% +10.0% ➖ noise
38 duckdb:vortex-compact -11.9% -0.2% -11.7% +10.6% ✅ faster
38 duckdb:vortex-file-compressed -2.4% -0.2% -2.2% +16.4% ➖ noise
39 datafusion:vortex-compact -0.2% -0.9% +0.7% +11.4% ➖ noise
39 datafusion:vortex-file-compressed -1.5% -0.9% -0.6% +13.1% ➖ noise
39 duckdb:duckdb -6.0% -0.9% -5.1% +16.9% ➖ noise
39 duckdb:vortex-compact +5.3% -0.9% +6.2% +10.2% ➖ noise
39 duckdb:vortex-file-compressed +8.5% -0.9% +9.5% +17.0% ➖ noise
40 datafusion:vortex-compact -3.3% -1.5% -1.9% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +1.5% -1.5% +3.0% +10.0% ➖ noise
40 duckdb:duckdb -17.2% -1.5% -16.0% +13.8% ✅ faster
40 duckdb:vortex-compact +0.7% -1.5% +2.2% +10.3% ➖ noise
40 duckdb:vortex-file-compressed -5.8% -1.5% -4.4% +12.2% ➖ noise
41 datafusion:vortex-compact -3.0% -4.9% +2.0% +10.4% ➖ noise
41 datafusion:vortex-file-compressed +7.7% -4.9% +13.2% +10.7% 🚨 regression
41 duckdb:duckdb -17.3% -4.9% -13.0% +12.5% ✅ faster
41 duckdb:vortex-compact +1.1% -4.9% +6.3% +19.8% ➖ noise
41 duckdb:vortex-file-compressed +2.1% -4.9% +7.3% +10.0% ➖ noise
42 datafusion:vortex-compact -3.9% -2.2% -1.7% +11.1% ➖ noise
42 datafusion:vortex-file-compressed +3.2% -2.2% +5.5% +10.6% ➖ noise
42 duckdb:duckdb -8.4% -2.2% -6.3% +19.6% ➖ noise
42 duckdb:vortex-compact +5.4% -2.2% +7.8% +10.3% ➖ noise
42 duckdb:vortex-file-compressed -5.5% -2.2% -3.3% +11.7% ➖ noise
43 datafusion:vortex-compact -1.7% +0.2% -2.0% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -0.8% +0.2% -1.0% +10.0% ➖ noise
43 duckdb:duckdb -0.0% +0.2% -0.3% +18.3% ➖ noise
43 duckdb:vortex-compact +2.2% +0.2% +2.0% +40.3% ➖ noise
43 duckdb:vortex-file-compressed -1.1% +0.2% -1.4% +22.6% ➖ noise
44 datafusion:vortex-compact +1.2% -1.9% +3.2% +10.0% ➖ noise
44 datafusion:vortex-file-compressed +1.9% -1.9% +3.9% +10.0% ➖ noise
44 duckdb:duckdb -7.6% -1.9% -5.8% +10.0% ➖ noise
44 duckdb:vortex-compact -0.6% -1.9% +1.3% +10.0% ➖ noise
44 duckdb:vortex-file-compressed -7.5% -1.9% -5.8% +10.2% ➖ noise
45 datafusion:vortex-compact +0.7% +0.2% +0.5% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -1.3% +0.2% -1.4% +10.0% ➖ noise
45 duckdb:duckdb -2.8% +0.2% -3.0% +10.5% ➖ noise
45 duckdb:vortex-compact +7.4% +0.2% +7.2% +10.0% ➖ noise
45 duckdb:vortex-file-compressed +16.1% +0.2% +15.9% +12.2% 🚨 regression
46 datafusion:vortex-compact +1.9% -1.7% +3.7% +10.0% ➖ noise
46 datafusion:vortex-file-compressed +1.7% -1.7% +3.5% +10.0% ➖ noise
46 duckdb:duckdb -1.9% -1.7% -0.1% +10.0% ➖ noise
46 duckdb:vortex-compact +0.9% -1.7% +2.7% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +3.3% -1.7% +5.2% +10.0% ➖ noise
47 datafusion:vortex-compact -0.6% +0.5% -1.1% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -0.5% +0.5% -1.0% +10.0% ➖ noise
47 duckdb:duckdb -3.9% +0.5% -4.3% +10.0% ➖ noise
47 duckdb:vortex-compact +0.0% +0.5% -0.5% +10.1% ➖ noise
47 duckdb:vortex-file-compressed -0.6% +0.5% -1.1% +10.0% ➖ noise
48 datafusion:vortex-compact +6.7% -1.6% +8.4% +10.0% ➖ noise
48 datafusion:vortex-file-compressed +10.9% -1.6% +12.7% +10.4% 🚨 regression
48 duckdb:duckdb -7.6% -1.6% -6.1% +10.0% ➖ noise
48 duckdb:vortex-compact +2.4% -1.6% +4.1% +10.0% ➖ noise
48 duckdb:vortex-file-compressed +1.3% -1.6% +3.0% +10.0% ➖ noise
49 datafusion:vortex-compact +8.9% -1.3% +10.4% +10.0% 🚨 regression
49 datafusion:vortex-file-compressed +14.8% -1.3% +16.3% +10.6% 🚨 regression
49 duckdb:duckdb -7.2% -1.3% -5.9% +19.5% ➖ noise
49 duckdb:vortex-compact +14.9% -1.3% +16.5% +12.8% 🚨 regression
49 duckdb:vortex-file-compressed +25.5% -1.3% +27.2% +25.2% 🚨 regression
50 datafusion:vortex-compact -1.2% +0.4% -1.6% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -1.4% +0.4% -1.8% +10.0% ➖ noise
50 duckdb:duckdb -3.5% +0.4% -3.8% +10.0% ➖ noise
50 duckdb:vortex-compact -0.3% +0.4% -0.7% +10.0% ➖ noise
50 duckdb:vortex-file-compressed +8.1% +0.4% +7.7% +10.0% ➖ noise
51 datafusion:vortex-compact +0.3% +0.5% -0.2% +11.7% ➖ noise
51 datafusion:vortex-file-compressed +4.7% +0.5% +4.2% +16.9% ➖ noise
51 duckdb:duckdb -2.2% +0.5% -2.7% +12.5% ➖ noise
51 duckdb:vortex-compact -1.0% +0.5% -1.5% +18.6% ➖ noise
51 duckdb:vortex-file-compressed +0.4% +0.5% -0.1% +23.4% ➖ noise
52 datafusion:vortex-compact -1.6% +3.6% -5.1% +12.9% ➖ noise
52 datafusion:vortex-file-compressed +1.9% +3.6% -1.7% +12.7% ➖ noise
52 duckdb:duckdb -6.8% +3.6% -10.0% +14.8% ➖ noise
52 duckdb:vortex-compact +1.6% +3.6% -1.9% +13.4% ➖ noise
52 duckdb:vortex-file-compressed +4.6% +3.6% +1.0% +19.8% ➖ noise
53 datafusion:vortex-compact -5.8% -3.0% -2.8% +10.2% ➖ noise
53 datafusion:vortex-file-compressed +2.7% -3.0% +5.9% +11.1% ➖ noise
53 duckdb:duckdb -5.4% -3.0% -2.4% +13.1% ➖ noise
53 duckdb:vortex-compact +3.9% -3.0% +7.2% +11.5% ➖ noise
53 duckdb:vortex-file-compressed -1.1% -3.0% +2.1% +12.2% ➖ noise
54 datafusion:vortex-compact -1.0% -0.5% -0.5% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -0.3% -0.5% +0.2% +10.0% ➖ noise
54 duckdb:duckdb -4.4% -0.5% -3.9% +19.6% ➖ noise
54 duckdb:vortex-compact -0.3% -0.5% +0.2% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +2.9% -0.5% +3.4% +10.0% ➖ noise
55 datafusion:vortex-compact +0.1% +1.8% -1.7% +11.9% ➖ noise
55 datafusion:vortex-file-compressed -7.7% +1.8% -9.3% +11.8% ➖ noise
55 duckdb:duckdb -8.7% +1.8% -10.3% +15.3% ➖ noise
55 duckdb:vortex-compact +1.4% +1.8% -0.4% +16.0% ➖ noise
55 duckdb:vortex-file-compressed +9.3% +1.8% +7.4% +19.8% ➖ noise
56 datafusion:vortex-compact -1.8% +3.8% -5.4% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -0.1% +3.8% -3.7% +10.0% ➖ noise
56 duckdb:duckdb +1.0% +3.8% -2.7% +10.6% ➖ noise
56 duckdb:vortex-compact -2.7% +3.8% -6.2% +10.0% ➖ noise
56 duckdb:vortex-file-compressed +6.8% +3.8% +2.9% +10.0% ➖ noise
57 datafusion:vortex-compact -0.0% +1.8% -1.8% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -1.0% +1.8% -2.8% +10.0% ➖ noise
57 duckdb:duckdb -1.5% +1.8% -3.3% +10.0% ➖ noise
57 duckdb:vortex-compact -0.2% +1.8% -2.0% +17.1% ➖ noise
57 duckdb:vortex-file-compressed +0.7% +1.8% -1.1% +11.3% ➖ noise
58 datafusion:vortex-compact +0.7% +0.8% -0.1% +10.0% ➖ noise
58 datafusion:vortex-file-compressed +0.5% +0.8% -0.3% +10.0% ➖ noise
58 duckdb:duckdb -8.8% +0.8% -9.5% +18.7% ➖ noise
58 duckdb:vortex-compact -0.5% +0.8% -1.3% +16.2% ➖ noise
58 duckdb:vortex-file-compressed +10.5% +0.8% +9.6% +13.6% ➖ noise
59 datafusion:vortex-compact -2.3% -1.3% -1.1% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +1.9% -1.3% +3.1% +10.0% ➖ noise
59 duckdb:duckdb -4.1% -1.3% -2.9% +10.0% ➖ noise
59 duckdb:vortex-compact -17.1% -1.3% -16.1% +10.0% ✅ faster
59 duckdb:vortex-file-compressed -6.7% -1.3% -5.5% +10.0% ➖ noise
60 datafusion:vortex-compact +1.5% -0.4% +2.0% +10.0% ➖ noise
60 datafusion:vortex-file-compressed +4.0% -0.4% +4.4% +10.6% ➖ noise
60 duckdb:duckdb +0.7% -0.4% +1.1% +11.8% ➖ noise
60 duckdb:vortex-compact -3.4% -0.4% -3.0% +10.0% ➖ noise
60 duckdb:vortex-file-compressed +10.7% -0.4% +11.2% +11.9% ➖ noise
61 datafusion:vortex-compact +2.3% -0.8% +3.1% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +2.4% -0.8% +3.3% +10.0% ➖ noise
61 duckdb:duckdb +1.5% -0.8% +2.4% +12.9% ➖ noise
61 duckdb:vortex-compact +2.0% -0.8% +2.9% +10.0% ➖ noise
61 duckdb:vortex-file-compressed +6.6% -0.8% +7.5% +13.6% ➖ noise
62 datafusion:vortex-compact +5.7% +2.1% +3.5% +16.0% ➖ noise
62 datafusion:vortex-file-compressed +0.1% +2.1% -1.9% +13.9% ➖ noise
62 duckdb:duckdb -4.8% +2.1% -6.7% +14.6% ➖ noise
62 duckdb:vortex-compact +31.1% +2.1% +28.4% +29.3% ➖ noise
62 duckdb:vortex-file-compressed +21.1% +2.1% +18.6% +23.7% ➖ noise
63 datafusion:vortex-compact +3.2% -2.2% +5.5% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +3.5% -2.2% +5.8% +10.0% ➖ noise
63 duckdb:duckdb -2.5% -2.2% -0.4% +10.0% ➖ noise
63 duckdb:vortex-compact -0.9% -2.2% +1.3% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +5.7% -2.2% +8.0% +10.0% ➖ noise
64 datafusion:vortex-compact +0.7% +2.3% -1.5% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -1.1% +2.3% -3.3% +10.0% ➖ noise
64 duckdb:duckdb -5.5% +2.3% -7.6% +11.5% ➖ noise
64 duckdb:vortex-compact +5.9% +2.3% +3.6% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +6.3% +2.3% +4.0% +10.0% ➖ noise
65 datafusion:vortex-compact +0.8% -0.1% +0.9% +10.0% ➖ noise
65 datafusion:vortex-file-compressed -2.4% -0.1% -2.3% +12.7% ➖ noise
65 duckdb:duckdb +0.5% -0.1% +0.7% +16.1% ➖ noise
65 duckdb:vortex-compact -0.8% -0.1% -0.6% +10.0% ➖ noise
65 duckdb:vortex-file-compressed +2.7% -0.1% +2.9% +10.0% ➖ noise
66 datafusion:vortex-compact +1.6% +6.6% -4.7% +12.8% ➖ noise
66 datafusion:vortex-file-compressed -4.6% +6.6% -10.5% +13.7% ➖ noise
66 duckdb:duckdb +2.2% +6.6% -4.1% +15.5% ➖ noise
66 duckdb:vortex-compact +0.8% +6.6% -5.4% +12.9% ➖ noise
66 duckdb:vortex-file-compressed -2.6% +6.6% -8.6% +19.1% ➖ noise
67 datafusion:vortex-compact -1.2% -1.8% +0.6% +10.0% ➖ noise
67 datafusion:vortex-file-compressed +0.4% -1.8% +2.2% +10.0% ➖ noise
67 duckdb:duckdb -7.2% -1.8% -5.5% +10.0% ➖ noise
67 duckdb:vortex-compact +3.1% -1.8% +5.0% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +2.0% -1.8% +3.9% +10.0% ➖ noise
68 datafusion:vortex-compact -0.0% -2.9% +2.9% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -0.0% -2.9% +3.0% +10.0% ➖ noise
68 duckdb:duckdb +1.1% -2.9% +4.1% +10.0% ➖ noise
68 duckdb:vortex-compact +2.8% -2.9% +5.9% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -2.5% -2.9% +0.4% +10.9% ➖ noise
69 datafusion:vortex-compact +0.8% +0.5% +0.3% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -4.1% +0.5% -4.6% +10.0% ➖ noise
69 duckdb:duckdb +0.3% +0.5% -0.3% +10.0% ➖ noise
69 duckdb:vortex-compact +6.9% +0.5% +6.4% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +2.3% +0.5% +1.8% +10.0% ➖ noise
70 datafusion:vortex-compact +5.2% -0.9% +6.1% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -0.5% -0.9% +0.4% +10.0% ➖ noise
70 duckdb:duckdb -2.1% -0.9% -1.3% +11.4% ➖ noise
70 duckdb:vortex-compact -0.7% -0.9% +0.1% +10.0% ➖ noise
70 duckdb:vortex-file-compressed +0.2% -0.9% +1.1% +10.0% ➖ noise
71 datafusion:vortex-compact +3.6% +4.1% -0.4% +10.0% ➖ noise
71 datafusion:vortex-file-compressed +9.5% +4.1% +5.2% +10.4% ➖ noise
71 duckdb:duckdb -8.1% +4.1% -11.7% +12.9% ✅ faster
71 duckdb:vortex-compact -3.4% +4.1% -7.2% +11.2% ➖ noise
71 duckdb:vortex-file-compressed -3.0% +4.1% -6.8% +14.4% ➖ noise
72 datafusion:vortex-compact -0.3% -0.6% +0.4% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -0.8% -0.6% -0.2% +10.0% ➖ noise
72 duckdb:duckdb +0.7% -0.6% +1.4% +12.2% ➖ noise
72 duckdb:vortex-compact -1.1% -0.6% -0.4% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +2.0% -0.6% +2.7% +10.0% ➖ noise
73 datafusion:vortex-compact +2.1% -0.6% +2.7% +13.0% ➖ noise
73 datafusion:vortex-file-compressed +3.0% -0.6% +3.6% +16.2% ➖ noise
73 duckdb:duckdb -1.7% -0.6% -1.1% +12.1% ➖ noise
73 duckdb:vortex-compact +0.8% -0.6% +1.5% +10.0% ➖ noise
73 duckdb:vortex-file-compressed -3.3% -0.6% -2.7% +10.0% ➖ noise
74 datafusion:vortex-compact -0.3% -1.1% +0.8% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +0.2% -1.1% +1.3% +10.0% ➖ noise
74 duckdb:duckdb +0.6% -1.1% +1.7% +10.0% ➖ noise
74 duckdb:vortex-compact +2.9% -1.1% +4.0% +10.0% ➖ noise
74 duckdb:vortex-file-compressed +7.5% -1.1% +8.6% +10.0% ➖ noise
75 datafusion:vortex-compact +2.3% -0.3% +2.6% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +1.6% -0.3% +1.9% +10.0% ➖ noise
75 duckdb:duckdb -3.0% -0.3% -2.7% +10.0% ➖ noise
75 duckdb:vortex-compact -1.6% -0.3% -1.3% +11.0% ➖ noise
75 duckdb:vortex-file-compressed -0.7% -0.3% -0.4% +10.3% ➖ noise
76 datafusion:vortex-compact +3.8% -2.1% +6.0% +10.0% ➖ noise
76 datafusion:vortex-file-compressed +0.8% -2.1% +3.0% +10.0% ➖ noise
76 duckdb:duckdb -7.2% -2.1% -5.2% +18.7% ➖ noise
76 duckdb:vortex-compact +6.6% -2.1% +8.9% +10.0% ➖ noise
76 duckdb:vortex-file-compressed +8.9% -2.1% +11.2% +17.4% ➖ noise
77 datafusion:vortex-compact +3.9% -2.6% +6.7% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -5.0% -2.6% -2.5% +10.0% ➖ noise
77 duckdb:duckdb -4.7% -2.6% -2.2% +12.4% ➖ noise
77 duckdb:vortex-compact -4.0% -2.6% -1.5% +10.0% ➖ noise
77 duckdb:vortex-file-compressed +11.6% -2.6% +14.6% +11.2% 🚨 regression
78 datafusion:vortex-compact +1.1% +1.8% -0.7% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -1.7% +1.8% -3.4% +10.0% ➖ noise
78 duckdb:duckdb -7.9% +1.8% -9.6% +14.2% ➖ noise
78 duckdb:vortex-compact -0.1% +1.8% -2.0% +10.0% ➖ noise
78 duckdb:vortex-file-compressed +2.7% +1.8% +0.9% +10.0% ➖ noise
79 datafusion:vortex-compact -1.1% +3.1% -4.1% +10.0% ➖ noise
79 datafusion:vortex-file-compressed -2.7% +3.1% -5.6% +10.0% ➖ noise
79 duckdb:duckdb -3.5% +3.1% -6.5% +10.0% ➖ noise
79 duckdb:vortex-compact -1.6% +3.1% -4.6% +10.0% ➖ noise
79 duckdb:vortex-file-compressed +9.7% +3.1% +6.4% +10.7% ➖ noise
80 datafusion:vortex-compact -0.1% +1.9% -2.0% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +2.3% +1.9% +0.3% +10.0% ➖ noise
80 duckdb:duckdb -5.9% +1.9% -7.7% +11.4% ➖ noise
80 duckdb:vortex-compact -1.8% +1.9% -3.6% +10.0% ➖ noise
80 duckdb:vortex-file-compressed +2.4% +1.9% +0.4% +10.0% ➖ noise
81 datafusion:vortex-compact +7.3% -1.4% +8.8% +12.9% ➖ noise
81 datafusion:vortex-file-compressed +7.2% -1.4% +8.7% +10.0% ➖ noise
81 duckdb:duckdb -8.1% -1.4% -6.8% +10.0% ➖ noise
81 duckdb:vortex-compact -10.8% -1.4% -9.5% +10.7% ➖ noise
81 duckdb:vortex-file-compressed -4.8% -1.4% -3.4% +11.5% ➖ noise
82 datafusion:vortex-compact +12.6% -0.0% +12.7% +15.6% ➖ noise
82 datafusion:vortex-file-compressed +15.1% -0.0% +15.1% +11.1% 🚨 regression
82 duckdb:duckdb -2.1% -0.0% -2.0% +19.8% ➖ noise
82 duckdb:vortex-compact +4.0% -0.0% +4.0% +10.9% ➖ noise
82 duckdb:vortex-file-compressed +16.7% -0.0% +16.7% +12.3% 🚨 regression
83 datafusion:vortex-compact -3.5% -1.2% -2.3% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -0.7% -1.2% +0.5% +10.0% ➖ noise
83 duckdb:duckdb -6.2% -1.2% -5.1% +13.0% ➖ noise
83 duckdb:vortex-compact +2.9% -1.2% +4.2% +10.0% ➖ noise
83 duckdb:vortex-file-compressed +6.4% -1.2% +7.6% +10.0% ➖ noise
84 datafusion:vortex-compact -1.6% -0.8% -0.8% +10.3% ➖ noise
84 datafusion:vortex-file-compressed -3.5% -0.8% -2.8% +11.3% ➖ noise
84 duckdb:duckdb +15.5% -0.8% +16.4% +12.4% 🚨 regression
84 duckdb:vortex-compact -0.8% -0.8% +0.0% +10.0% ➖ noise
84 duckdb:vortex-file-compressed +4.9% -0.8% +5.7% +10.0% ➖ noise
85 datafusion:vortex-compact -0.3% -0.9% +0.6% +10.0% ➖ noise
85 datafusion:vortex-file-compressed -0.3% -0.9% +0.7% +10.0% ➖ noise
85 duckdb:duckdb -1.8% -0.9% -0.9% +10.0% ➖ noise
85 duckdb:vortex-compact -2.5% -0.9% -1.6% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +1.8% -0.9% +2.8% +10.0% ➖ noise
86 datafusion:vortex-compact -1.1% +6.2% -6.8% +10.0% ➖ noise
86 datafusion:vortex-file-compressed -3.3% +6.2% -8.9% +10.5% ➖ noise
86 duckdb:duckdb -8.1% +6.2% -13.4% +11.9% ✅ faster
86 duckdb:vortex-compact +6.9% +6.2% +0.7% +16.3% ➖ noise
86 duckdb:vortex-file-compressed +1.9% +6.2% -4.0% +17.0% ➖ noise
87 datafusion:vortex-compact -3.1% +0.7% -3.7% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -1.1% +0.7% -1.7% +10.0% ➖ noise
87 duckdb:duckdb +2.6% +0.7% +1.9% +10.0% ➖ noise
87 duckdb:vortex-compact +6.0% +0.7% +5.3% +15.6% ➖ noise
87 duckdb:vortex-file-compressed +1.8% +0.7% +1.2% +14.0% ➖ noise
88 datafusion:vortex-compact +0.2% +0.0% +0.1% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -2.3% +0.0% -2.3% +10.0% ➖ noise
88 duckdb:duckdb -2.3% +0.0% -2.3% +10.0% ➖ noise
88 duckdb:vortex-compact -1.6% +0.0% -1.6% +11.3% ➖ noise
88 duckdb:vortex-file-compressed +0.9% +0.0% +0.9% +10.1% ➖ noise
89 datafusion:vortex-compact +1.1% -1.1% +2.3% +10.0% ➖ noise
89 datafusion:vortex-file-compressed +0.4% -1.1% +1.6% +10.3% ➖ noise
89 duckdb:duckdb -1.6% -1.1% -0.4% +12.9% ➖ noise
89 duckdb:vortex-compact +4.4% -1.1% +5.6% +10.6% ➖ noise
89 duckdb:vortex-file-compressed -2.9% -1.1% -1.8% +12.8% ➖ noise
90 datafusion:vortex-compact +0.1% -3.2% +3.4% +10.7% ➖ noise
90 datafusion:vortex-file-compressed +0.1% -3.2% +3.4% +10.8% ➖ noise
90 duckdb:duckdb -10.6% -3.2% -7.7% +11.2% ➖ noise
90 duckdb:vortex-compact -11.6% -3.2% -8.7% +13.1% ➖ noise
90 duckdb:vortex-file-compressed +1.6% -3.2% +4.9% +12.4% ➖ noise
91 datafusion:vortex-compact -1.3% +1.2% -2.5% +10.0% ➖ noise
91 datafusion:vortex-file-compressed -0.8% +1.2% -2.0% +10.0% ➖ noise
91 duckdb:duckdb -2.2% +1.2% -3.4% +10.0% ➖ noise
91 duckdb:vortex-compact -0.0% +1.2% -1.3% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +3.7% +1.2% +2.4% +10.0% ➖ noise
92 datafusion:vortex-compact -2.5% -4.3% +1.9% +10.0% ➖ noise
92 datafusion:vortex-file-compressed -7.5% -4.3% -3.4% +10.0% ➖ noise
92 duckdb:duckdb -12.4% -4.3% -8.5% +17.5% ➖ noise
92 duckdb:vortex-compact -5.8% -4.3% -1.6% +14.6% ➖ noise
92 duckdb:vortex-file-compressed -4.2% -4.3% +0.1% +13.5% ➖ noise
93 datafusion:vortex-compact -0.8% -0.3% -0.5% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -1.7% -0.3% -1.4% +10.0% ➖ noise
93 duckdb:duckdb -6.9% -0.3% -6.6% +17.3% ➖ noise
93 duckdb:vortex-compact -11.0% -0.3% -10.7% +14.0% ➖ noise
93 duckdb:vortex-file-compressed +10.7% -0.3% +11.1% +16.5% ➖ noise
94 datafusion:vortex-compact +0.6% +4.6% -3.8% +10.0% ➖ noise
94 datafusion:vortex-file-compressed -0.7% +4.6% -5.0% +10.0% ➖ noise
94 duckdb:duckdb -6.2% +4.6% -10.3% +15.2% ➖ noise
94 duckdb:vortex-compact -14.0% +4.6% -17.8% +17.6% ✅ faster
94 duckdb:vortex-file-compressed +3.0% +4.6% -1.6% +10.0% ➖ noise
95 datafusion:vortex-compact +1.6% -5.5% +7.5% +10.4% ➖ noise
95 datafusion:vortex-file-compressed +0.7% -5.5% +6.5% +10.0% ➖ noise
95 duckdb:duckdb -17.8% -5.5% -13.0% +19.4% ➖ noise
95 duckdb:vortex-compact -10.0% -5.5% -4.8% +16.1% ➖ noise
95 duckdb:vortex-file-compressed +11.5% -5.5% +18.0% +20.1% ➖ noise
96 datafusion:vortex-compact +5.1% +0.5% +4.6% +10.0% ➖ noise
96 datafusion:vortex-file-compressed +0.9% +0.5% +0.4% +10.7% ➖ noise
96 duckdb:duckdb -5.9% +0.5% -6.4% +15.7% ➖ noise
96 duckdb:vortex-compact -0.9% +0.5% -1.3% +22.1% ➖ noise
96 duckdb:vortex-file-compressed +0.7% +0.5% +0.2% +22.9% ➖ noise
97 datafusion:vortex-compact -0.1% +2.1% -2.2% +10.0% ➖ noise
97 datafusion:vortex-file-compressed -2.9% +2.1% -4.9% +10.0% ➖ noise
97 duckdb:duckdb -4.0% +2.1% -6.0% +11.0% ➖ noise
97 duckdb:vortex-compact -2.6% +2.1% -4.6% +16.0% ➖ noise
97 duckdb:vortex-file-compressed +1.1% +2.1% -1.0% +12.8% ➖ noise
98 datafusion:vortex-compact -5.1% -0.3% -4.8% +10.1% ➖ noise
98 datafusion:vortex-file-compressed -2.9% -0.3% -2.6% +10.2% ➖ noise
98 duckdb:duckdb -4.0% -0.3% -3.8% +13.3% ➖ noise
98 duckdb:vortex-compact -1.3% -0.3% -1.0% +11.6% ➖ noise
98 duckdb:vortex-file-compressed +4.0% -0.3% +4.3% +13.3% ➖ noise
99 datafusion:vortex-compact -2.8% +7.9% -9.9% +14.5% ➖ noise
99 datafusion:vortex-file-compressed -5.0% +7.9% -12.0% +13.3% ✅ faster
99 duckdb:duckdb +3.6% +7.9% -4.0% +27.2% ➖ noise
99 duckdb:vortex-compact +4.3% +7.9% -3.3% +13.1% ➖ noise
99 duckdb:vortex-file-compressed -9.9% +7.9% -16.5% +24.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +5.3%
Vortex (geomean): 1.089x ➖
Parquet (geomean): 1.005x ➖
Shifts: Parquet (control) +0.5% · Median polish +2.6%


datafusion / vortex-file-compressed (1.058x ➖, 0↑ 4↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 392666217 416688928 0.94
tpch_q02/datafusion:vortex-file-compressed 114669629 110721311 1.04
tpch_q03/datafusion:vortex-file-compressed 211653543 199880497 1.06
tpch_q04/datafusion:vortex-file-compressed 🚨 108410810 97053566 1.12
tpch_q05/datafusion:vortex-file-compressed 382687607 381184596 1.00
tpch_q06/datafusion:vortex-file-compressed 🚨 60048742 40679340 1.48
tpch_q07/datafusion:vortex-file-compressed 579035644 552145914 1.05
tpch_q08/datafusion:vortex-file-compressed 386478357 377186517 1.02
tpch_q09/datafusion:vortex-file-compressed 653843793 656809296 1.00
tpch_q10/datafusion:vortex-file-compressed 255575525 232902737 1.10
tpch_q11/datafusion:vortex-file-compressed 85888880 84517425 1.02
tpch_q12/datafusion:vortex-file-compressed 🚨 114232635 103737802 1.10
tpch_q13/datafusion:vortex-file-compressed 219826486 217489264 1.01
tpch_q14/datafusion:vortex-file-compressed 61811574 57571889 1.07
tpch_q15/datafusion:vortex-file-compressed 🚨 119594300 105825425 1.13
tpch_q16/datafusion:vortex-file-compressed 79501223 78110198 1.02
tpch_q17/datafusion:vortex-file-compressed 639517053 641715817 1.00
tpch_q18/datafusion:vortex-file-compressed 869766236 862549543 1.01
tpch_q19/datafusion:vortex-file-compressed 93534013 87861305 1.06
tpch_q20/datafusion:vortex-file-compressed 185413360 168904740 1.10
tpch_q21/datafusion:vortex-file-compressed 688288756 653804206 1.05
tpch_q22/datafusion:vortex-file-compressed 61556191 62272139 0.99
datafusion / vortex-compact (1.046x ➖, 0↑ 2↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 427064591 452956837 0.94
tpch_q02/datafusion:vortex-compact 118666852 117391526 1.01
tpch_q03/datafusion:vortex-compact 229953030 219651446 1.05
tpch_q04/datafusion:vortex-compact 127339994 119311753 1.07
tpch_q05/datafusion:vortex-compact 396640170 391615953 1.01
tpch_q06/datafusion:vortex-compact 🚨 84021849 62161546 1.35
tpch_q07/datafusion:vortex-compact 609817369 586206430 1.04
tpch_q08/datafusion:vortex-compact 401108135 383776710 1.05
tpch_q09/datafusion:vortex-compact 672521791 670518370 1.00
tpch_q10/datafusion:vortex-compact 294660702 268704999 1.10
tpch_q11/datafusion:vortex-compact 93110476 88887490 1.05
tpch_q12/datafusion:vortex-compact 178291536 163753708 1.09
tpch_q13/datafusion:vortex-compact 268997568 266618047 1.01
tpch_q14/datafusion:vortex-compact 79586958 74201355 1.07
tpch_q15/datafusion:vortex-compact 🚨 181432307 163223934 1.11
tpch_q16/datafusion:vortex-compact 82266502 81431934 1.01
tpch_q17/datafusion:vortex-compact 646893714 660189309 0.98
tpch_q18/datafusion:vortex-compact 878290674 888222722 0.99
tpch_q19/datafusion:vortex-compact 138965795 136710345 1.02
tpch_q20/datafusion:vortex-compact 206840713 196254447 1.05
tpch_q21/datafusion:vortex-compact 732195923 695056319 1.05
tpch_q22/datafusion:vortex-compact 73107350 71069879 1.03
datafusion / parquet (1.008x ➖, 0↑ 1↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 450420016 405755530 1.11
tpch_q02/datafusion:parquet 183387803 181561254 1.01
tpch_q03/datafusion:parquet 296573614 295516476 1.00
tpch_q04/datafusion:parquet 131617911 129735472 1.01
tpch_q05/datafusion:parquet 438698802 439079283 1.00
tpch_q06/datafusion:parquet 120178166 118124417 1.02
tpch_q07/datafusion:parquet 628964970 620003842 1.01
tpch_q08/datafusion:parquet 485310211 481684301 1.01
tpch_q09/datafusion:parquet 751532784 758510831 0.99
tpch_q10/datafusion:parquet 497152031 492238695 1.01
tpch_q11/datafusion:parquet 129278942 127039836 1.02
tpch_q12/datafusion:parquet 204568722 220842535 0.93
tpch_q13/datafusion:parquet 335079597 334181020 1.00
tpch_q14/datafusion:parquet 157129057 154705391 1.02
tpch_q15/datafusion:parquet 246962650 233193093 1.06
tpch_q16/datafusion:parquet 140099719 135396045 1.03
tpch_q17/datafusion:parquet 671231310 680647922 0.99
tpch_q18/datafusion:parquet 867590504 868097439 1.00
tpch_q19/datafusion:parquet 264849201 282273437 0.94
tpch_q20/datafusion:parquet 306636736 305234301 1.00
tpch_q21/datafusion:parquet 723735835 724671615 1.00
tpch_q22/datafusion:parquet 228132352 219443017 1.04
datafusion / arrow (0.989x ➖, 0↑ 0↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 589913842 575119259 1.03
tpch_q02/datafusion:arrow 162457387 169409784 0.96
tpch_q03/datafusion:arrow 443312022 453165449 0.98
tpch_q04/datafusion:arrow 337452266 333190334 1.01
tpch_q05/datafusion:arrow 874817213 875270300 1.00
tpch_q06/datafusion:arrow 260334485 267195712 0.97
tpch_q07/datafusion:arrow 1082240493 1098296027 0.99
tpch_q08/datafusion:arrow 1067962201 1089871212 0.98
tpch_q09/datafusion:arrow 1275512180 1283391366 0.99
tpch_q10/datafusion:arrow 581324120 584833679 0.99
tpch_q11/datafusion:arrow 148657043 150495559 0.99
tpch_q12/datafusion:arrow 630913195 667445513 0.95
tpch_q13/datafusion:arrow 515801579 506583054 1.02
tpch_q14/datafusion:arrow 292000944 296245194 0.99
tpch_q15/datafusion:arrow 621684504 621766148 1.00
tpch_q16/datafusion:arrow 106621901 106418440 1.00
tpch_q17/datafusion:arrow 1287208989 1307175459 0.98
tpch_q18/datafusion:arrow 1792749082 1810827156 0.99
tpch_q19/datafusion:arrow 481316981 496976687 0.97
tpch_q20/datafusion:arrow 472567111 475454699 0.99
tpch_q21/datafusion:arrow 2756846014 2804954290 0.98
tpch_q22/datafusion:arrow 142845358 142773421 1.00
duckdb / vortex-file-compressed (1.138x ❌, 0↑ 13↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 186409376 175954766 1.06
tpch_q02/duckdb:vortex-file-compressed 55215577 51387646 1.07
tpch_q03/duckdb:vortex-file-compressed 🚨 148763422 126289416 1.18
tpch_q04/duckdb:vortex-file-compressed 🚨 190907373 149320966 1.28
tpch_q05/duckdb:vortex-file-compressed 139844949 130561111 1.07
tpch_q06/duckdb:vortex-file-compressed 🚨 66673560 51321170 1.30
tpch_q07/duckdb:vortex-file-compressed 🚨 191321161 147596705 1.30
tpch_q08/duckdb:vortex-file-compressed 187482913 176401909 1.06
tpch_q09/duckdb:vortex-file-compressed 342814172 335197500 1.02
tpch_q10/duckdb:vortex-file-compressed 🚨 180975461 156012716 1.16
tpch_q11/duckdb:vortex-file-compressed 🚨 40939806 35981050 1.14
tpch_q12/duckdb:vortex-file-compressed 🚨 128002925 87726799 1.46
tpch_q13/duckdb:vortex-file-compressed 256541034 247665775 1.04
tpch_q14/duckdb:vortex-file-compressed 🚨 87676670 70147652 1.25
tpch_q15/duckdb:vortex-file-compressed 🚨 110650821 97441358 1.14
tpch_q16/duckdb:vortex-file-compressed 82750828 78040363 1.06
tpch_q17/duckdb:vortex-file-compressed 🚨 115384563 102811528 1.12
tpch_q18/duckdb:vortex-file-compressed 272473245 285863629 0.95
tpch_q19/duckdb:vortex-file-compressed 🚨 104545222 91126037 1.15
tpch_q20/duckdb:vortex-file-compressed 🚨 184417614 165762762 1.11
tpch_q21/duckdb:vortex-file-compressed 🚨 660968253 552903404 1.20
tpch_q22/duckdb:vortex-file-compressed 80052358 76865159 1.04
duckdb / vortex-compact (1.116x ❌, 0↑ 12↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 240255794 228366943 1.05
tpch_q02/duckdb:vortex-compact 60330066 56156480 1.07
tpch_q03/duckdb:vortex-compact 🚨 162139355 140863323 1.15
tpch_q04/duckdb:vortex-compact 🚨 213892492 174869505 1.22
tpch_q05/duckdb:vortex-compact 153288485 148140398 1.03
tpch_q06/duckdb:vortex-compact 🚨 116869476 82714741 1.41
tpch_q07/duckdb:vortex-compact 🚨 242813863 202358476 1.20
tpch_q08/duckdb:vortex-compact 202695111 190072726 1.07
tpch_q09/duckdb:vortex-compact 367980468 363438517 1.01
tpch_q10/duckdb:vortex-compact 🚨 212574937 185447650 1.15
tpch_q11/duckdb:vortex-compact 44737124 41153878 1.09
tpch_q12/duckdb:vortex-compact 🚨 244784785 201485519 1.21
tpch_q13/duckdb:vortex-compact 306260613 294102121 1.04
tpch_q14/duckdb:vortex-compact 🚨 121744699 99759166 1.22
tpch_q15/duckdb:vortex-compact 🚨 132001083 117526739 1.12
tpch_q16/duckdb:vortex-compact 88028851 85913118 1.02
tpch_q17/duckdb:vortex-compact 🚨 129302494 115233672 1.12
tpch_q18/duckdb:vortex-compact 286929244 290145957 0.99
tpch_q19/duckdb:vortex-compact 🚨 129136857 113320042 1.14
tpch_q20/duckdb:vortex-compact 🚨 226327132 203757741 1.11
tpch_q21/duckdb:vortex-compact 🚨 724547953 622438721 1.16
tpch_q22/duckdb:vortex-compact 91827469 89303726 1.03
duckdb / parquet (1.001x ➖, 0↑ 0↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 265122338 257583706 1.03
tpch_q02/duckdb:parquet 103456609 105260922 0.98
tpch_q03/duckdb:parquet 214425239 213365912 1.00
tpch_q04/duckdb:parquet 134311845 136448547 0.98
tpch_q05/duckdb:parquet 217080599 222322484 0.98
tpch_q06/duckdb:parquet 67032664 68214513 0.98
tpch_q07/duckdb:parquet 181689650 183088809 0.99
tpch_q08/duckdb:parquet 257662586 256164970 1.01
tpch_q09/duckdb:parquet 458623620 460843772 1.00
tpch_q10/duckdb:parquet 601965289 598967428 1.01
tpch_q11/duckdb:parquet 44077558 41614791 1.06
tpch_q12/duckdb:parquet 124349129 123194844 1.01
tpch_q13/duckdb:parquet 446031672 456144996 0.98
tpch_q14/duckdb:parquet 174151268 174867130 1.00
tpch_q15/duckdb:parquet 98562542 97405411 1.01
tpch_q16/duckdb:parquet 163526908 161217702 1.01
tpch_q17/duckdb:parquet 178146524 177999201 1.00
tpch_q18/duckdb:parquet 349665793 350237323 1.00
tpch_q19/duckdb:parquet 283905339 286271326 0.99
tpch_q20/duckdb:parquet 232336928 228137194 1.02
tpch_q21/duckdb:parquet 570063783 569083750 1.00
tpch_q22/duckdb:parquet 286927126 292539947 0.98
duckdb / duckdb (1.007x ➖, 0↑ 0↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 117436119 115961974 1.01
tpch_q02/duckdb:duckdb 44581860 44595372 1.00
tpch_q03/duckdb:duckdb 97082741 95684117 1.01
tpch_q04/duckdb:duckdb 131888028 132314588 1.00
tpch_q05/duckdb:duckdb 108109982 110630862 0.98
tpch_q06/duckdb:duckdb 39540689 38928341 1.02
tpch_q07/duckdb:duckdb 86175865 86316209 1.00
tpch_q08/duckdb:duckdb 110238962 110451999 1.00
tpch_q09/duckdb:duckdb 273263279 278438359 0.98
tpch_q10/duckdb:duckdb 201790299 199266316 1.01
tpch_q11/duckdb:duckdb 15828994 15227610 1.04
tpch_q12/duckdb:duckdb 84371090 85240212 0.99
tpch_q13/duckdb:duckdb 251227918 246239966 1.02
tpch_q14/duckdb:duckdb 71562564 70423353 1.02
tpch_q15/duckdb:duckdb 78476778 77525758 1.01
tpch_q16/duckdb:duckdb 72964913 73983125 0.99
tpch_q17/duckdb:duckdb 84524545 84145550 1.00
tpch_q18/duckdb:duckdb 212452767 214033329 0.99
tpch_q19/duckdb:duckdb 115265908 115259714 1.00
tpch_q20/duckdb:duckdb 111920344 112113326 1.00
tpch_q21/duckdb:duckdb 297838964 299703090 0.99
tpch_q22/duckdb:duckdb 71010479 64838124 1.10
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +2.6% +6.9% -4.0% +13.0% ➖ noise
1 datafusion:vortex-compact -5.7% +6.9% -11.8% +13.5% ➖ noise
1 datafusion:vortex-file-compressed -5.8% +6.9% -11.8% +15.4% ➖ noise
1 duckdb:duckdb +1.3% +6.9% -5.3% +12.3% ➖ noise
1 duckdb:vortex-compact +5.2% +6.9% -1.6% +12.2% ➖ noise
1 duckdb:vortex-file-compressed +5.9% +6.9% -0.9% +13.1% ➖ noise
2 datafusion:arrow -4.1% -0.4% -3.8% +10.0% ➖ noise
2 datafusion:vortex-compact +1.1% -0.4% +1.5% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +3.6% -0.4% +3.9% +11.0% ➖ noise
2 duckdb:duckdb -0.0% -0.4% +0.3% +10.4% ➖ noise
2 duckdb:vortex-compact +7.4% -0.4% +7.8% +12.9% ➖ noise
2 duckdb:vortex-file-compressed +7.4% -0.4% +7.8% +13.2% ➖ noise
3 datafusion:arrow -2.2% +0.4% -2.6% +10.0% ➖ noise
3 datafusion:vortex-compact +4.7% +0.4% +4.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +5.9% +0.4% +5.4% +10.0% ➖ noise
3 duckdb:duckdb +1.5% +0.4% +1.0% +10.0% ➖ noise
3 duckdb:vortex-compact +15.1% +0.4% +14.6% +10.0% 🚨 regression
3 duckdb:vortex-file-compressed +17.8% +0.4% +17.3% +10.0% 🚨 regression
4 datafusion:arrow +1.3% -0.1% +1.3% +10.0% ➖ noise
4 datafusion:vortex-compact +6.7% -0.1% +6.8% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +11.7% -0.1% +11.8% +10.0% 🚨 regression
4 duckdb:duckdb -0.3% -0.1% -0.3% +10.0% ➖ noise
4 duckdb:vortex-compact +22.3% -0.1% +22.4% +10.0% 🚨 regression
4 duckdb:vortex-file-compressed +27.9% -0.1% +27.9% +10.0% 🚨 regression
5 datafusion:arrow -0.1% -1.2% +1.2% +10.0% ➖ noise
5 datafusion:vortex-compact +1.3% -1.2% +2.5% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.4% -1.2% +1.6% +10.0% ➖ noise
5 duckdb:duckdb -2.3% -1.2% -1.1% +10.0% ➖ noise
5 duckdb:vortex-compact +3.5% -1.2% +4.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +7.1% -1.2% +8.4% +10.0% ➖ noise
6 datafusion:arrow -2.6% -0.0% -2.6% +10.0% ➖ noise
6 datafusion:vortex-compact +35.2% -0.0% +35.2% +10.0% 🚨 regression
6 datafusion:vortex-file-compressed +47.6% -0.0% +47.6% +10.0% 🚨 regression
6 duckdb:duckdb +1.6% -0.0% +1.6% +16.6% ➖ noise
6 duckdb:vortex-compact +41.3% -0.0% +41.3% +10.0% 🚨 regression
6 duckdb:vortex-file-compressed +29.9% -0.0% +29.9% +18.6% 🚨 regression
7 datafusion:arrow -1.5% +0.3% -1.8% +10.0% ➖ noise
7 datafusion:vortex-compact +4.0% +0.3% +3.7% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +4.9% +0.3% +4.5% +10.0% ➖ noise
7 duckdb:duckdb -0.2% +0.3% -0.5% +10.0% ➖ noise
7 duckdb:vortex-compact +20.0% +0.3% +19.6% +10.0% 🚨 regression
7 duckdb:vortex-file-compressed +29.6% +0.3% +29.2% +10.0% 🚨 regression
8 datafusion:arrow -2.0% +0.7% -2.7% +10.0% ➖ noise
8 datafusion:vortex-compact +4.5% +0.7% +3.8% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +2.5% +0.7% +1.8% +10.0% ➖ noise
8 duckdb:duckdb -0.2% +0.7% -0.9% +10.0% ➖ noise
8 duckdb:vortex-compact +6.6% +0.7% +5.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +6.3% +0.7% +5.6% +10.0% ➖ noise
9 datafusion:arrow -0.6% -0.7% +0.1% +10.0% ➖ noise
9 datafusion:vortex-compact +0.3% -0.7% +1.0% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.5% -0.7% +0.3% +10.0% ➖ noise
9 duckdb:duckdb -1.9% -0.7% -1.2% +10.0% ➖ noise
9 duckdb:vortex-compact +1.2% -0.7% +2.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +2.3% -0.7% +3.0% +10.0% ➖ noise
10 datafusion:arrow -0.6% +0.7% -1.3% +10.0% ➖ noise
10 datafusion:vortex-compact +9.7% +0.7% +8.8% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +9.7% +0.7% +8.9% +10.0% ➖ noise
10 duckdb:duckdb +1.3% +0.7% +0.5% +10.0% ➖ noise
10 duckdb:vortex-compact +14.6% +0.7% +13.8% +10.0% 🚨 regression
10 duckdb:vortex-file-compressed +16.0% +0.7% +15.1% +10.0% 🚨 regression
11 datafusion:arrow -1.2% +3.8% -4.9% +10.1% ➖ noise
11 datafusion:vortex-compact +4.8% +3.8% +0.9% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +1.6% +3.8% -2.1% +10.0% ➖ noise
11 duckdb:duckdb +3.9% +3.8% +0.1% +16.4% ➖ noise
11 duckdb:vortex-compact +8.7% +3.8% +4.7% +13.5% ➖ noise
11 duckdb:vortex-file-compressed +13.8% +3.8% +9.6% +11.9% ➖ noise
12 datafusion:arrow -5.5% -3.3% -2.2% +47.2% ➖ noise
12 datafusion:vortex-compact +8.9% -3.3% +12.6% +10.0% 🚨 regression
12 datafusion:vortex-file-compressed +10.1% -3.3% +13.9% +10.0% 🚨 regression
12 duckdb:duckdb -1.0% -3.3% +2.4% +10.0% ➖ noise
12 duckdb:vortex-compact +21.5% -3.3% +25.6% +10.0% 🚨 regression
12 duckdb:vortex-file-compressed +45.9% -3.3% +50.9% +10.0% 🚨 regression
13 datafusion:arrow +1.8% -1.0% +2.8% +10.0% ➖ noise
13 datafusion:vortex-compact +0.9% -1.0% +1.9% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +1.1% -1.0% +2.1% +10.0% ➖ noise
13 duckdb:duckdb +2.0% -1.0% +3.0% +10.0% ➖ noise
13 duckdb:vortex-compact +4.1% -1.0% +5.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +3.6% -1.0% +4.6% +10.0% ➖ noise
14 datafusion:arrow -1.4% +0.6% -2.0% +10.0% ➖ noise
14 datafusion:vortex-compact +7.3% +0.6% +6.6% +12.4% ➖ noise
14 datafusion:vortex-file-compressed +7.4% +0.6% +6.8% +11.0% ➖ noise
14 duckdb:duckdb +1.6% +0.6% +1.0% +10.0% ➖ noise
14 duckdb:vortex-compact +22.0% +0.6% +21.3% +10.0% 🚨 regression
14 duckdb:vortex-file-compressed +25.0% +0.6% +24.3% +10.0% 🚨 regression
15 datafusion:arrow -0.0% +3.5% -3.4% +10.0% ➖ noise
15 datafusion:vortex-compact +11.2% +3.5% +7.4% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +13.0% +3.5% +9.2% +10.0% ➖ noise
15 duckdb:duckdb +1.2% +3.5% -2.2% +10.0% ➖ noise
15 duckdb:vortex-compact +12.3% +3.5% +8.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +13.6% +3.5% +9.7% +10.0% ➖ noise
16 datafusion:arrow +0.2% +2.4% -2.2% +10.0% ➖ noise
16 datafusion:vortex-compact +1.0% +2.4% -1.4% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +1.8% +2.4% -0.7% +10.0% ➖ noise
16 duckdb:duckdb -1.4% +2.4% -3.7% +10.0% ➖ noise
16 duckdb:vortex-compact +2.5% +2.4% +0.0% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +6.0% +2.4% +3.5% +10.0% ➖ noise
17 datafusion:arrow -1.5% -0.7% -0.9% +10.0% ➖ noise
17 datafusion:vortex-compact -2.0% -0.7% -1.4% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -0.3% -0.7% +0.3% +10.0% ➖ noise
17 duckdb:duckdb +0.5% -0.7% +1.1% +10.0% ➖ noise
17 duckdb:vortex-compact +12.2% -0.7% +12.9% +10.0% 🚨 regression
17 duckdb:vortex-file-compressed +12.2% -0.7% +13.0% +10.0% 🚨 regression
18 datafusion:arrow -1.0% -0.1% -0.9% +10.0% ➖ noise
18 datafusion:vortex-compact -1.1% -0.1% -1.0% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +0.8% -0.1% +0.9% +10.0% ➖ noise
18 duckdb:duckdb -0.7% -0.1% -0.6% +10.0% ➖ noise
18 duckdb:vortex-compact -1.1% -0.1% -1.0% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -4.7% -0.1% -4.6% +10.0% ➖ noise
19 datafusion:arrow -3.2% -3.5% +0.4% +10.0% ➖ noise
19 datafusion:vortex-compact +1.6% -3.5% +5.4% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +6.5% -3.5% +10.4% +10.0% 🚨 regression
19 duckdb:duckdb +0.0% -3.5% +3.7% +10.0% ➖ noise
19 duckdb:vortex-compact +14.0% -3.5% +18.1% +10.0% 🚨 regression
19 duckdb:vortex-file-compressed +14.7% -3.5% +18.9% +10.0% 🚨 regression
20 datafusion:arrow -0.6% +1.1% -1.7% +10.0% ➖ noise
20 datafusion:vortex-compact +5.4% +1.1% +4.2% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +9.8% +1.1% +8.5% +10.0% ➖ noise
20 duckdb:duckdb -0.2% +1.1% -1.3% +10.0% ➖ noise
20 duckdb:vortex-compact +11.1% +1.1% +9.8% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +11.3% +1.1% +10.0% +10.0% ➖ noise
21 datafusion:arrow -1.7% +0.0% -1.7% +10.0% ➖ noise
21 datafusion:vortex-compact +5.3% +0.0% +5.3% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +5.3% +0.0% +5.3% +10.0% ➖ noise
21 duckdb:duckdb -0.6% +0.0% -0.6% +10.0% ➖ noise
21 duckdb:vortex-compact +16.4% +0.0% +16.4% +10.0% 🚨 regression
21 duckdb:vortex-file-compressed +19.5% +0.0% +19.5% +10.0% 🚨 regression
22 datafusion:arrow +0.1% +1.0% -0.9% +10.0% ➖ noise
22 datafusion:vortex-compact +2.9% +1.0% +1.9% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -1.1% +1.0% -2.1% +10.0% ➖ noise
22 duckdb:duckdb +9.5% +1.0% +8.5% +10.0% ➖ noise
22 duckdb:vortex-compact +2.8% +1.0% +1.8% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +4.1% +1.0% +3.1% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -10.3%
Vortex (geomean): 0.944x ➖
Parquet (geomean): 1.053x ➖
Shifts: Parquet (control) +5.3% · Median polish -1.2%


datafusion / vortex-file-compressed (0.947x ➖, 2↑ 4↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 64263613 37761892 1.70
fineweb_q01/datafusion:vortex-file-compressed 413903596 508276215 0.81
fineweb_q02/datafusion:vortex-file-compressed 🚀 379936799 560370438 0.68
fineweb_q03/datafusion:vortex-file-compressed 🚨 2716648556 1700095947 1.60
fineweb_q04/datafusion:vortex-file-compressed 🚨 2766504183 1432775387 1.93
fineweb_q05/datafusion:vortex-file-compressed 🚨 2608546853 1470953397 1.77
fineweb_q06/datafusion:vortex-file-compressed 1456757159 1569950871 0.93
fineweb_q07/datafusion:vortex-file-compressed 1361978570 1407563776 0.97
fineweb_q08/datafusion:vortex-file-compressed 🚀 71430568 538870106 0.13
datafusion / vortex-compact (0.727x ➖, 3↑ 0↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 39907609 33891076 1.18
fineweb_q01/datafusion:vortex-compact 🚀 403352710 586290189 0.69
fineweb_q02/datafusion:vortex-compact 🚀 367378524 622290285 0.59
fineweb_q03/datafusion:vortex-compact 2151128973 1893779227 1.14
fineweb_q04/datafusion:vortex-compact 2424193979 2311934897 1.05
fineweb_q05/datafusion:vortex-compact 2018872861 1749578052 1.15
fineweb_q06/datafusion:vortex-compact 1370491426 1437185065 0.95
fineweb_q07/datafusion:vortex-compact 1270656689 1379894040 0.92
fineweb_q08/datafusion:vortex-compact 🚀 38719942 393600878 0.10
datafusion / parquet (1.088x ➖, 0↑ 0↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1259310607 1240933659 1.01
fineweb_q01/datafusion:parquet 1859878263 1756965018 1.06
fineweb_q02/datafusion:parquet 2012804162 1822249583 1.10
fineweb_q03/datafusion:parquet 2076299224 1855518127 1.12
fineweb_q04/datafusion:parquet 2206783927 1816759880 1.21
fineweb_q05/datafusion:parquet 2249688800 1868153839 1.20
fineweb_q06/datafusion:parquet 1972991062 1993918157 0.99
fineweb_q07/datafusion:parquet 1829841245 1818108422 1.01
fineweb_q08/datafusion:parquet 2000627662 1817588606 1.10
duckdb / vortex-file-compressed (1.045x ➖, 1↑ 4↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 104803408 95742117 1.09
fineweb_q01/duckdb:vortex-file-compressed 408343003 571096479 0.72
fineweb_q02/duckdb:vortex-file-compressed 🚨 616065374 470021741 1.31
fineweb_q03/duckdb:vortex-file-compressed 🚨 2919486460 1528419904 1.91
fineweb_q04/duckdb:vortex-file-compressed 🚨 2892109130 1655807962 1.75
fineweb_q05/duckdb:vortex-file-compressed 🚨 2771272939 1601548194 1.73
fineweb_q06/duckdb:vortex-file-compressed 1636793548 1688314545 0.97
fineweb_q07/duckdb:vortex-file-compressed 1514209162 1470317182 1.03
fineweb_q08/duckdb:vortex-file-compressed 🚀 156288457 621124156 0.25
duckdb / vortex-compact (1.104x ➖, 0↑ 3↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 109153482 56026102 1.95
fineweb_q01/duckdb:vortex-compact 465971422 534124772 0.87
fineweb_q02/duckdb:vortex-compact 470599149 592244104 0.79
fineweb_q03/duckdb:vortex-compact 🚨 2307947643 1700422357 1.36
fineweb_q04/duckdb:vortex-compact 2323555065 1804664005 1.29
fineweb_q05/duckdb:vortex-compact 🚨 2180809179 1581741382 1.38
fineweb_q06/duckdb:vortex-compact 1448317591 1459526437 0.99
fineweb_q07/duckdb:vortex-compact 1427312252 1393845643 1.02
fineweb_q08/duckdb:vortex-compact 327949920 444521086 0.74
duckdb / parquet (1.020x ➖, 0↑ 0↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1117959432 1092628354 1.02
fineweb_q01/duckdb:parquet 1664349394 1681692263 0.99
fineweb_q02/duckdb:parquet 1728104137 1727899157 1.00
fineweb_q03/duckdb:parquet 4395372024 4091584142 1.07
fineweb_q04/duckdb:parquet 1985410119 1845823339 1.08
fineweb_q05/duckdb:parquet 2766472139 2857577951 0.97
fineweb_q06/duckdb:parquet 3796306896 3555839396 1.07
fineweb_q07/duckdb:parquet 3982317376 4138665475 0.96
fineweb_q08/duckdb:parquet 1142492798 1117210882 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +17.8% +1.9% +15.6% +185.5% ➖ noise
0 datafusion:vortex-file-compressed +70.2% +1.9% +67.0% +258.7% ➖ noise
0 duckdb:vortex-compact +94.8% +1.9% +91.2% +69.4% 🚨 regression
0 duckdb:vortex-file-compressed +9.5% +1.9% +7.4% +37.6% ➖ noise
1 datafusion:vortex-compact -31.2% +2.4% -32.8% +57.3% ➖ noise
1 datafusion:vortex-file-compressed -18.6% +2.4% -20.4% +104.3% ➖ noise
1 duckdb:vortex-compact -12.8% +2.4% -14.8% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -28.5% +2.4% -30.1% +30.0% ✅ faster
2 datafusion:vortex-compact -41.0% +5.1% -43.8% +30.0% ✅ faster
2 datafusion:vortex-file-compressed -32.2% +5.1% -35.5% +32.9% ✅ faster
2 duckdb:vortex-compact -20.5% +5.1% -24.4% +30.0% ✅ faster
2 duckdb:vortex-file-compressed +31.1% +5.1% +24.7% +30.0% ➖ noise
3 datafusion:vortex-compact +13.6% +9.6% +3.6% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +59.8% +9.6% +45.7% +30.0% 🚨 regression
3 duckdb:vortex-compact +35.7% +9.6% +23.8% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +91.0% +9.6% +74.2% +30.0% 🚨 regression
4 datafusion:vortex-compact +4.9% +14.3% -8.3% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +93.1% +14.3% +68.9% +30.0% 🚨 regression
4 duckdb:vortex-compact +28.8% +14.3% +12.6% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +74.7% +14.3% +52.8% +30.0% 🚨 regression
5 datafusion:vortex-compact +15.4% +8.0% +6.9% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +77.3% +8.0% +64.2% +30.0% 🚨 regression
5 duckdb:vortex-compact +37.9% +8.0% +27.7% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +73.0% +8.0% +60.3% +30.0% 🚨 regression
6 datafusion:vortex-compact -4.6% +2.8% -7.2% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -7.2% +2.8% -9.7% +30.0% ➖ noise
6 duckdb:vortex-compact -0.8% +2.8% -3.5% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -3.1% +2.8% -5.7% +30.0% ➖ noise
7 datafusion:vortex-compact -7.9% -1.6% -6.4% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -3.2% -1.6% -1.7% +30.0% ➖ noise
7 duckdb:vortex-compact +2.4% -1.6% +4.1% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +3.0% -1.6% +4.7% +30.0% ➖ noise
8 datafusion:vortex-compact -90.2% +6.1% -90.7% +30.0% ✅ faster
8 datafusion:vortex-file-compressed -86.7% +6.1% -87.5% +46.4% ✅ faster
8 duckdb:vortex-compact -26.2% +6.1% -30.5% +69.7% ➖ noise
8 duckdb:vortex-file-compressed -74.8% +6.1% -76.3% +30.0% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +10.9%
Vortex (geomean): 1.172x ➖
Parquet (geomean): 1.057x ➖
Shifts: Parquet (control) +5.7% · Median polish +14.0%


datafusion / vortex-file-compressed (1.153x ➖, 0↑ 6↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 200482238 214098841 0.94
tpch_q02/datafusion:vortex-file-compressed 575009310 477088448 1.21
tpch_q03/datafusion:vortex-file-compressed 380305799 476603929 0.80
tpch_q04/datafusion:vortex-file-compressed 224902298 237417054 0.95
tpch_q05/datafusion:vortex-file-compressed 471666267 375129593 1.26
tpch_q06/datafusion:vortex-file-compressed 305427531 271192132 1.13
tpch_q07/datafusion:vortex-file-compressed 🚨 515361989 361268195 1.43
tpch_q08/datafusion:vortex-file-compressed 568597058 639590428 0.89
tpch_q09/datafusion:vortex-file-compressed 512484857 403509471 1.27
tpch_q10/datafusion:vortex-file-compressed 524204768 449921586 1.17
tpch_q11/datafusion:vortex-file-compressed 386149673 414504069 0.93
tpch_q12/datafusion:vortex-file-compressed 496859106 489120625 1.02
tpch_q13/datafusion:vortex-file-compressed 245170365 218289769 1.12
tpch_q14/datafusion:vortex-file-compressed 238951330 190960232 1.25
tpch_q15/datafusion:vortex-file-compressed 🚨 467319415 316885509 1.47
tpch_q16/datafusion:vortex-file-compressed 🚨 286677092 196971065 1.46
tpch_q17/datafusion:vortex-file-compressed 426660993 418629324 1.02
tpch_q18/datafusion:vortex-file-compressed 363911407 342488115 1.06
tpch_q19/datafusion:vortex-file-compressed 435675947 374114121 1.16
tpch_q20/datafusion:vortex-file-compressed 🚨 557679830 366461178 1.52
tpch_q21/datafusion:vortex-file-compressed 🚨 602359547 451971905 1.33
tpch_q22/datafusion:vortex-file-compressed 🚨 192384918 139275478 1.38
datafusion / vortex-compact (1.279x ➖, 0↑ 11↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 245213825 253919386 0.97
tpch_q02/datafusion:vortex-compact 516257009 445362421 1.16
tpch_q03/datafusion:vortex-compact 379737683 482275994 0.79
tpch_q04/datafusion:vortex-compact 279709984 292154888 0.96
tpch_q05/datafusion:vortex-compact 452960937 399822297 1.13
tpch_q06/datafusion:vortex-compact 🚨 481697979 304790921 1.58
tpch_q07/datafusion:vortex-compact 🚨 661314015 439498463 1.50
tpch_q08/datafusion:vortex-compact 651882431 541138517 1.20
tpch_q09/datafusion:vortex-compact 432654296 375375219 1.15
tpch_q10/datafusion:vortex-compact 🚨 680513105 436156600 1.56
tpch_q11/datafusion:vortex-compact 🚨 435304815 306019336 1.42
tpch_q12/datafusion:vortex-compact 🚨 931199889 425542910 2.19
tpch_q13/datafusion:vortex-compact 🚨 319305885 207133497 1.54
tpch_q14/datafusion:vortex-compact 🚨 347995080 252261378 1.38
tpch_q15/datafusion:vortex-compact 🚨 701016447 484649687 1.45
tpch_q16/datafusion:vortex-compact 🚨 292708457 189380506 1.55
tpch_q17/datafusion:vortex-compact 🚨 527314600 382398284 1.38
tpch_q18/datafusion:vortex-compact 342129724 350196982 0.98
tpch_q19/datafusion:vortex-compact 481568663 472164299 1.02
tpch_q20/datafusion:vortex-compact 545953175 422542935 1.29
tpch_q21/datafusion:vortex-compact 685231275 572605101 1.20
tpch_q22/datafusion:vortex-compact 🚨 211114293 146602583 1.44
datafusion / parquet (1.130x ➖, 0↑ 5↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 257942149 226489580 1.14
tpch_q02/datafusion:parquet 🚨 639442154 481434586 1.33
tpch_q03/datafusion:parquet 🚨 488356336 331389226 1.47
tpch_q04/datafusion:parquet 🚨 207414120 145588448 1.42
tpch_q05/datafusion:parquet 🚨 631473099 452504596 1.40
tpch_q06/datafusion:parquet 145397693 132867180 1.09
tpch_q07/datafusion:parquet 543691012 456576341 1.19
tpch_q08/datafusion:parquet 654128115 602181421 1.09
tpch_q09/datafusion:parquet 475335932 502775517 0.95
tpch_q10/datafusion:parquet 523398009 620214546 0.84
tpch_q11/datafusion:parquet 356797130 376096353 0.95
tpch_q12/datafusion:parquet 255955138 228628058 1.12
tpch_q13/datafusion:parquet 457849851 442134277 1.04
tpch_q14/datafusion:parquet 169526745 168001115 1.01
tpch_q15/datafusion:parquet 292127700 286812056 1.02
tpch_q16/datafusion:parquet 183875081 169293940 1.09
tpch_q17/datafusion:parquet 416794028 387613145 1.08
tpch_q18/datafusion:parquet 474950362 441508798 1.08
tpch_q19/datafusion:parquet 362786524 318867380 1.14
tpch_q20/datafusion:parquet 354231133 328944045 1.08
tpch_q21/datafusion:parquet 546337818 513242590 1.06
tpch_q22/datafusion:parquet 🚨 177560130 111632815 1.59
duckdb / vortex-file-compressed (1.148x ➖, 0↑ 4↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 291135839 308585517 0.94
tpch_q02/duckdb:vortex-file-compressed 🚨 1610433320 931956851 1.73
tpch_q03/duckdb:vortex-file-compressed 789605662 634127516 1.25
tpch_q04/duckdb:vortex-file-compressed 487632112 384550534 1.27
tpch_q05/duckdb:vortex-file-compressed 1025887228 935509746 1.10
tpch_q06/duckdb:vortex-file-compressed 463374320 422955687 1.10
tpch_q07/duckdb:vortex-file-compressed 975592643 820321454 1.19
tpch_q08/duckdb:vortex-file-compressed 🚨 1376584583 983993549 1.40
tpch_q09/duckdb:vortex-file-compressed 1140968453 952635381 1.20
tpch_q10/duckdb:vortex-file-compressed 763898104 767577942 1.00
tpch_q11/duckdb:vortex-file-compressed 690228326 576827456 1.20
tpch_q12/duckdb:vortex-file-compressed 🚨 708119623 498077942 1.42
tpch_q13/duckdb:vortex-file-compressed 444697603 471309068 0.94
tpch_q14/duckdb:vortex-file-compressed 573624286 500995368 1.14
tpch_q15/duckdb:vortex-file-compressed 245808568 268042803 0.92
tpch_q16/duckdb:vortex-file-compressed 🚨 535581020 398133591 1.35
tpch_q17/duckdb:vortex-file-compressed 765540075 716933797 1.07
tpch_q18/duckdb:vortex-file-compressed 517662805 580100099 0.89
tpch_q19/duckdb:vortex-file-compressed 555688960 470317653 1.18
tpch_q20/duckdb:vortex-file-compressed 982125368 907169220 1.08
tpch_q21/duckdb:vortex-file-compressed 1159605353 1180226428 0.98
tpch_q22/duckdb:vortex-file-compressed 472859879 381409011 1.24
duckdb / vortex-compact (1.117x ➖, 1↑ 3↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 260511258 290520593 0.90
tpch_q02/duckdb:vortex-compact 1328848816 1045820090 1.27
tpch_q03/duckdb:vortex-compact 734163501 573954060 1.28
tpch_q04/duckdb:vortex-compact 441301181 369924799 1.19
tpch_q05/duckdb:vortex-compact 1028415949 910327596 1.13
tpch_q06/duckdb:vortex-compact 541119623 576026723 0.94
tpch_q07/duckdb:vortex-compact 863351748 757071948 1.14
tpch_q08/duckdb:vortex-compact 1203618160 1002604652 1.20
tpch_q09/duckdb:vortex-compact 1150641714 902735173 1.27
tpch_q10/duckdb:vortex-compact 668201438 656742655 1.02
tpch_q11/duckdb:vortex-compact 637561358 499376272 1.28
tpch_q12/duckdb:vortex-compact 🚨 665605486 500776961 1.33
tpch_q13/duckdb:vortex-compact 🚀 346790139 524998179 0.66
tpch_q14/duckdb:vortex-compact 517015040 541252709 0.96
tpch_q15/duckdb:vortex-compact 274942106 279123402 0.99
tpch_q16/duckdb:vortex-compact 504483369 415602883 1.21
tpch_q17/duckdb:vortex-compact 666142227 607887989 1.10
tpch_q18/duckdb:vortex-compact 432438361 465292347 0.93
tpch_q19/duckdb:vortex-compact 594467727 474776467 1.25
tpch_q20/duckdb:vortex-compact 🚨 1033521214 736903121 1.40
tpch_q21/duckdb:vortex-compact 1124682726 996226720 1.13
tpch_q22/duckdb:vortex-compact 🚨 472490116 352255061 1.34
duckdb / parquet (0.988x ➖, 1↑ 0↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 497822038 521108241 0.96
tpch_q02/duckdb:parquet 1417458105 1342235671 1.06
tpch_q03/duckdb:parquet 1055805521 1026146144 1.03
tpch_q04/duckdb:parquet 652862959 636840912 1.03
tpch_q05/duckdb:parquet 1495170250 1548245109 0.97
tpch_q06/duckdb:parquet 473820592 499633808 0.95
tpch_q07/duckdb:parquet 1384915399 1302291975 1.06
tpch_q08/duckdb:parquet 1531973546 1682612756 0.91
tpch_q09/duckdb:parquet 1523578357 1624553099 0.94
tpch_q10/duckdb:parquet 1554173878 1529670681 1.02
tpch_q11/duckdb:parquet 888732697 898817438 0.99
tpch_q12/duckdb:parquet 743110540 706354379 1.05
tpch_q13/duckdb:parquet 981087425 984660348 1.00
tpch_q14/duckdb:parquet 689474773 662557186 1.04
tpch_q15/duckdb:parquet 587100589 559402710 1.05
tpch_q16/duckdb:parquet 645194688 586073748 1.10
tpch_q17/duckdb:parquet 🚀 762039859 1127211185 0.68
tpch_q18/duckdb:parquet 863265952 858502648 1.01
tpch_q19/duckdb:parquet 889498233 919602863 0.97
tpch_q20/duckdb:parquet 1122510079 1071305010 1.05
tpch_q21/duckdb:parquet 1214253432 1301702036 0.93
tpch_q22/duckdb:parquet 588030425 552089268 1.07
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -3.4% +4.3% -7.4% +150.3% ➖ noise
1 datafusion:vortex-file-compressed -6.4% +4.3% -10.2% +172.4% ➖ noise
1 duckdb:vortex-compact -10.3% +4.3% -14.0% +42.3% ➖ noise
1 duckdb:vortex-file-compressed -5.7% +4.3% -9.5% +65.8% ➖ noise
2 datafusion:vortex-compact +15.9% +18.4% -2.1% +47.9% ➖ noise
2 datafusion:vortex-file-compressed +20.5% +18.4% +1.8% +44.6% ➖ noise
2 duckdb:vortex-compact +27.1% +18.4% +7.3% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +72.8% +18.4% +45.9% +30.0% 🚨 regression
3 datafusion:vortex-compact -21.3% +23.1% -36.1% +97.6% ➖ noise
3 datafusion:vortex-file-compressed -20.2% +23.1% -35.2% +100.0% ➖ noise
3 duckdb:vortex-compact +27.9% +23.1% +3.9% +43.0% ➖ noise
3 duckdb:vortex-file-compressed +24.5% +23.1% +1.1% +42.3% ➖ noise
4 datafusion:vortex-compact -4.3% +20.9% -20.8% +65.3% ➖ noise
4 datafusion:vortex-file-compressed -5.3% +20.9% -21.6% +31.3% ➖ noise
4 duckdb:vortex-compact +19.3% +20.9% -1.3% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +26.8% +20.9% +4.9% +30.0% ➖ noise
5 datafusion:vortex-compact +13.3% +16.1% -2.4% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +25.7% +16.1% +8.3% +30.0% ➖ noise
5 duckdb:vortex-compact +13.0% +16.1% -2.7% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +9.7% +16.1% -5.5% +30.0% ➖ noise
6 datafusion:vortex-compact +58.0% +1.9% +55.1% +35.7% 🚨 regression
6 datafusion:vortex-file-compressed +12.6% +1.9% +10.6% +61.5% ➖ noise
6 duckdb:vortex-compact -6.1% +1.9% -7.8% +39.8% ➖ noise
6 duckdb:vortex-file-compressed +9.6% +1.9% +7.5% +30.0% ➖ noise
7 datafusion:vortex-compact +50.5% +12.5% +33.7% +46.5% ➖ noise
7 datafusion:vortex-file-compressed +42.7% +12.5% +26.8% +32.9% ➖ noise
7 duckdb:vortex-compact +14.0% +12.5% +1.3% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +18.9% +12.5% +5.7% +46.2% ➖ noise
8 datafusion:vortex-compact +20.5% -0.6% +21.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -11.1% -0.6% -10.6% +37.7% ➖ noise
8 duckdb:vortex-compact +20.0% -0.6% +20.7% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +39.9% -0.6% +40.7% +30.0% 🚨 regression
9 datafusion:vortex-compact +15.3% -5.8% +22.4% +43.6% ➖ noise
9 datafusion:vortex-file-compressed +27.0% -5.8% +34.9% +30.0% 🚨 regression
9 duckdb:vortex-compact +27.5% -5.8% +35.4% +30.0% 🚨 regression
9 duckdb:vortex-file-compressed +19.8% -5.8% +27.2% +30.0% ➖ noise
10 datafusion:vortex-compact +56.0% -7.4% +68.5% +42.5% 🚨 regression
10 datafusion:vortex-file-compressed +16.5% -7.4% +25.8% +38.8% ➖ noise
10 duckdb:vortex-compact +1.7% -7.4% +9.9% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -0.5% -7.4% +7.5% +30.0% ➖ noise
11 datafusion:vortex-compact +42.2% -3.1% +46.9% +42.4% 🚨 regression
11 datafusion:vortex-file-compressed -6.8% -3.1% -3.8% +30.0% ➖ noise
11 duckdb:vortex-compact +27.7% -3.1% +31.8% +30.0% 🚨 regression
11 duckdb:vortex-file-compressed +19.7% -3.1% +23.5% +30.0% ➖ noise
12 datafusion:vortex-compact +118.8% +8.5% +101.6% +68.3% 🚨 regression
12 datafusion:vortex-file-compressed +1.6% +8.5% -6.4% +55.8% ➖ noise
12 duckdb:vortex-compact +32.9% +8.5% +22.5% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +42.2% +8.5% +31.0% +34.9% ➖ noise
13 datafusion:vortex-compact +54.2% +1.6% +51.8% +139.0% ➖ noise
13 datafusion:vortex-file-compressed +12.3% +1.6% +10.6% +62.7% ➖ noise
13 duckdb:vortex-compact -33.9% +1.6% -35.0% +34.2% ✅ faster
13 duckdb:vortex-file-compressed -5.6% +1.6% -7.1% +30.9% ➖ noise
14 datafusion:vortex-compact +38.0% +2.5% +34.6% +56.0% ➖ noise
14 datafusion:vortex-file-compressed +25.1% +2.5% +22.1% +89.2% ➖ noise
14 duckdb:vortex-compact -4.5% +2.5% -6.8% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +14.5% +2.5% +11.7% +30.0% ➖ noise
15 datafusion:vortex-compact +44.6% +3.4% +39.9% +42.1% ➖ noise
15 datafusion:vortex-file-compressed +47.5% +3.4% +42.6% +39.8% 🚨 regression
15 duckdb:vortex-compact -1.5% +3.4% -4.7% +36.9% ➖ noise
15 duckdb:vortex-file-compressed -8.3% +3.4% -11.3% +42.6% ➖ noise
16 datafusion:vortex-compact +54.6% +9.3% +41.3% +30.0% 🚨 regression
16 datafusion:vortex-file-compressed +45.5% +9.3% +33.1% +30.0% 🚨 regression
16 duckdb:vortex-compact +21.4% +9.3% +11.0% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +34.5% +9.3% +23.0% +30.0% ➖ noise
17 datafusion:vortex-compact +37.9% -14.7% +61.7% +63.0% ➖ noise
17 datafusion:vortex-file-compressed +1.9% -14.7% +19.5% +45.0% ➖ noise
17 duckdb:vortex-compact +9.6% -14.7% +28.5% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +6.8% -14.7% +25.2% +49.9% ➖ noise
18 datafusion:vortex-compact -2.3% +4.0% -6.1% +50.0% ➖ noise
18 datafusion:vortex-file-compressed +6.3% +4.0% +2.2% +30.0% ➖ noise
18 duckdb:vortex-compact -7.1% +4.0% -10.6% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -10.8% +4.0% -14.2% +30.0% ➖ noise
19 datafusion:vortex-compact +2.0% +4.9% -2.8% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +16.5% +4.9% +11.0% +49.1% ➖ noise
19 duckdb:vortex-compact +25.2% +4.9% +19.4% +35.9% ➖ noise
19 duckdb:vortex-file-compressed +18.2% +4.9% +12.6% +30.0% ➖ noise
20 datafusion:vortex-compact +29.2% +6.2% +21.6% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +52.2% +6.2% +43.3% +30.0% 🚨 regression
20 duckdb:vortex-compact +40.3% +6.2% +32.0% +30.0% 🚨 regression
20 duckdb:vortex-file-compressed +8.3% +6.2% +1.9% +30.0% ➖ noise
21 datafusion:vortex-compact +19.7% -0.4% +20.1% +41.4% ➖ noise
21 datafusion:vortex-file-compressed +33.3% -0.4% +33.7% +33.2% 🚨 regression
21 duckdb:vortex-compact +12.9% -0.4% +13.3% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -1.7% -0.4% -1.4% +31.0% ➖ noise
22 datafusion:vortex-compact +44.0% +30.2% +10.6% +30.0% ➖ noise
22 datafusion:vortex-file-compressed +38.1% +30.2% +6.1% +31.0% ➖ noise
22 duckdb:vortex-compact +34.1% +30.2% +3.1% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +24.0% +30.2% -4.7% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: Random Access

Vortex (geomean): 0.928x ➖
Parquet (geomean): 1.022x ➖


unknown / unknown (1.011x ➖, 7↑ 6↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 2958441 2555759 1.16
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1438416 1325164 1.09
random-access/feature-vectors/correlated/parquet-tokio-local-disk 12055694050 11708402278 1.03
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 11477066379 11219530771 1.02
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚀 7229669 8501861 0.85
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 6953556 6813947 1.02
random-access/feature-vectors/uniform/lance-tokio-local-disk 🚨 1701509 1536876 1.11
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2708603 2469933 1.10
random-access/feature-vectors/uniform/parquet-tokio-local-disk 11487439277 11177933463 1.03
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 11318110264 11199628036 1.01
random-access/feature-vectors/uniform/vortex-tokio-local-disk 13146094 14360231 0.92
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 13521604 14636563 0.92
random-access/lance-tokio-local-disk 809861 737651 1.10
random-access/lance-tokio-local-disk-footer 1492475 1359144 1.10
random-access/nested-lists/correlated/lance-tokio-local-disk 291967 275392 1.06
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 802304 740336 1.08
random-access/nested-lists/correlated/parquet-tokio-local-disk 145747555 138806595 1.05
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 146504408 139873666 1.05
random-access/nested-lists/correlated/vortex-tokio-local-disk 730381 722525 1.01
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚨 808277 726062 1.11
random-access/nested-lists/uniform/lance-tokio-local-disk 1288820 1193987 1.08
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1829800 1676623 1.09
random-access/nested-lists/uniform/parquet-tokio-local-disk 147216081 138233143 1.06
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 146122211 137971336 1.06
random-access/nested-lists/uniform/vortex-tokio-local-disk 2516735 2609971 0.96
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 🚀 2601866 2904555 0.90
random-access/nested-structs/correlated/lance-tokio-local-disk 466564 444753 1.05
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 700372 661665 1.06
random-access/nested-structs/correlated/parquet-tokio-local-disk 29646147 30713708 0.97
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 29149616 29279142 1.00
random-access/nested-structs/correlated/vortex-tokio-local-disk 941500 911261 1.03
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚨 992901 893723 1.11
random-access/nested-structs/uniform/lance-tokio-local-disk 3116739 2913068 1.07
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3394292 3153647 1.08
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚨 29607245 26863666 1.10
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚀 29856748 33271803 0.90
random-access/nested-structs/uniform/vortex-tokio-local-disk 1871811 1831296 1.02
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1888923 1883631 1.00
random-access/parquet-tokio-local-disk 190379670 186098488 1.02
random-access/parquet-tokio-local-disk-footer 190278782 185437631 1.03
random-access/taxi/correlated/lance-tokio-local-disk 1047158 964403 1.09
random-access/taxi/correlated/lance-tokio-local-disk-footer 1807835 1648349 1.10
random-access/taxi/correlated/parquet-tokio-local-disk 281085070 279067075 1.01
random-access/taxi/correlated/parquet-tokio-local-disk-footer 284088332 278634831 1.02
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 2111913 2660080 0.79
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 2134948 2639827 0.81
random-access/taxi/uniform/lance-tokio-local-disk 🚨 9348043 8409052 1.11
random-access/taxi/uniform/lance-tokio-local-disk-footer 9983518 9110960 1.10
random-access/taxi/uniform/parquet-tokio-local-disk 300891648 292147546 1.03
random-access/taxi/uniform/parquet-tokio-local-disk-footer 304211521 295151495 1.03
random-access/taxi/uniform/vortex-tokio-local-disk 4885884 5416802 0.90
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4932696 5462347 0.90
random-access/vortex-tokio-local-disk 🚀 1407661 1755203 0.80
random-access/vortex-tokio-local-disk-footer 🚀 1398710 1873964 0.75

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.0%
Vortex (geomean): 0.975x ➖
Parquet (geomean): 1.006x ➖
Shifts: Parquet (control) +0.6% · Median polish -0.2%


duckdb / vortex-file-compressed (0.986x ➖, 0↑ 0↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 10688135 11167147 0.96
statpopgen_q01/duckdb:vortex-file-compressed 19158674 19307823 0.99
statpopgen_q02/duckdb:vortex-file-compressed 1301709828 1300465250 1.00
statpopgen_q03/duckdb:vortex-file-compressed 3065481099 3125635535 0.98
statpopgen_q04/duckdb:vortex-file-compressed 3031712158 3111494669 0.97
statpopgen_q05/duckdb:vortex-file-compressed 1369927687 1391228335 0.98
statpopgen_q06/duckdb:vortex-file-compressed 2062610314 2058141808 1.00
statpopgen_q07/duckdb:vortex-file-compressed 217877237 222153263 0.98
statpopgen_q08/duckdb:vortex-file-compressed 227642283 236332792 0.96
statpopgen_q09/duckdb:vortex-file-compressed 2819015668 2821574356 1.00
statpopgen_q10/duckdb:vortex-file-compressed 4610660958 4557476306 1.01
duckdb / vortex-compact (0.964x ➖, 1↑ 0↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10541762 10688344 0.99
statpopgen_q01/duckdb:vortex-compact 🚀 112867355 163557941 0.69
statpopgen_q02/duckdb:vortex-compact 1808742119 1842285308 0.98
statpopgen_q03/duckdb:vortex-compact 3464425785 3484426314 0.99
statpopgen_q04/duckdb:vortex-compact 3505029536 3473838338 1.01
statpopgen_q05/duckdb:vortex-compact 1818245883 1797366212 1.01
statpopgen_q06/duckdb:vortex-compact 2647726538 2666901487 0.99
statpopgen_q07/duckdb:vortex-compact 928015727 929427610 1.00
statpopgen_q08/duckdb:vortex-compact 960878433 964644070 1.00
statpopgen_q09/duckdb:vortex-compact 3306401504 3295806180 1.00
statpopgen_q10/duckdb:vortex-compact 5372703961 5383523911 1.00
duckdb / parquet (1.006x ➖, 0↑ 0↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 309215365 311458989 0.99
statpopgen_q01/duckdb:parquet 393043016 389244760 1.01
statpopgen_q02/duckdb:parquet 994391164 979083946 1.02
statpopgen_q03/duckdb:parquet 1498252009 1498373975 1.00
statpopgen_q04/duckdb:parquet 1520306310 1513795631 1.00
statpopgen_q05/duckdb:parquet 1006520392 1004528693 1.00
statpopgen_q06/duckdb:parquet 1479319383 1471675016 1.01
statpopgen_q07/duckdb:parquet 1883091659 1848087855 1.02
statpopgen_q08/duckdb:parquet 1860695325 1868501862 1.00
statpopgen_q09/duckdb:parquet 1375909408 1352414612 1.02
statpopgen_q10/duckdb:parquet 2645937492 2642198900 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -1.4% -0.7% -0.7% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -4.3% -0.7% -3.6% +17.2% ➖ noise
1 duckdb:vortex-compact -31.0% +1.0% -31.7% +48.7% ➖ noise
1 duckdb:vortex-file-compressed -0.8% +1.0% -1.7% +207.7% ➖ noise
2 duckdb:vortex-compact -1.8% +1.6% -3.3% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.1% +1.6% -1.4% +10.0% ➖ noise
3 duckdb:vortex-compact -0.6% -0.0% -0.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -1.9% -0.0% -1.9% +10.0% ➖ noise
4 duckdb:vortex-compact +0.9% +0.4% +0.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -2.6% +0.4% -3.0% +10.0% ➖ noise
5 duckdb:vortex-compact +1.2% +0.2% +1.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.5% +0.2% -1.7% +10.0% ➖ noise
6 duckdb:vortex-compact -0.7% +0.5% -1.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.2% +0.5% -0.3% +10.0% ➖ noise
7 duckdb:vortex-compact -0.2% +1.9% -2.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -1.9% +1.9% -3.7% +29.2% ➖ noise
8 duckdb:vortex-compact -0.4% -0.4% +0.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -3.7% -0.4% -3.3% +10.0% ➖ noise
9 duckdb:vortex-compact +0.3% +1.7% -1.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.1% +1.7% -1.8% +10.0% ➖ noise
10 duckdb:vortex-compact -0.2% +0.1% -0.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +1.2% +0.1% +1.0% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Vortex (geomean): 1.115x ❌
Parquet (geomean): 1.073x ➖
Shifts: Parquet (control) +7.3% · Median polish +6.9%


datafusion / vortex-file-compressed (1.153x ❌, 0↑ 32↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚨 2170771 1875757 1.16
clickbench_q01/datafusion:vortex-file-compressed 🚨 15361198 13855112 1.11
clickbench_q02/datafusion:vortex-file-compressed 36291769 33681195 1.08
clickbench_q03/datafusion:vortex-file-compressed 🚨 47362550 39322835 1.20
clickbench_q04/datafusion:vortex-file-compressed 🚨 333136472 293067007 1.14
clickbench_q05/datafusion:vortex-file-compressed 🚨 357068776 316645233 1.13
clickbench_q06/datafusion:vortex-file-compressed 2063415 2089253 0.99
clickbench_q07/datafusion:vortex-file-compressed 🚨 21330213 18006838 1.18
clickbench_q08/datafusion:vortex-file-compressed 🚨 440833395 380248424 1.16
clickbench_q09/datafusion:vortex-file-compressed 🚨 647056042 556716460 1.16
clickbench_q10/datafusion:vortex-file-compressed 🚨 88007826 73781222 1.19
clickbench_q11/datafusion:vortex-file-compressed 🚨 107287073 82900747 1.29
clickbench_q12/datafusion:vortex-file-compressed 🚨 323274125 268374261 1.20
clickbench_q13/datafusion:vortex-file-compressed 🚨 479693982 406363223 1.18
clickbench_q14/datafusion:vortex-file-compressed 🚨 310554038 253860753 1.22
clickbench_q15/datafusion:vortex-file-compressed 🚨 407278612 356213583 1.14
clickbench_q16/datafusion:vortex-file-compressed 🚨 783055550 689381010 1.14
clickbench_q17/datafusion:vortex-file-compressed 🚨 781747790 679805988 1.15
clickbench_q18/datafusion:vortex-file-compressed 🚨 1536911176 1310906408 1.17
clickbench_q19/datafusion:vortex-file-compressed 23781512 22556016 1.05
clickbench_q20/datafusion:vortex-file-compressed 369508191 358508597 1.03
clickbench_q21/datafusion:vortex-file-compressed 🚨 440974901 399056956 1.11
clickbench_q22/datafusion:vortex-file-compressed 🚨 614370111 476636670 1.29
clickbench_q23/datafusion:vortex-file-compressed 🚨 796350080 623625250 1.28
clickbench_q24/datafusion:vortex-file-compressed 🚨 63836738 46857481 1.36
clickbench_q25/datafusion:vortex-file-compressed 🚨 89004963 74818803 1.19
clickbench_q26/datafusion:vortex-file-compressed 🚨 61900197 45786327 1.35
clickbench_q27/datafusion:vortex-file-compressed 🚨 887617366 778082939 1.14
clickbench_q28/datafusion:vortex-file-compressed 7209772944 6899526222 1.04
clickbench_q29/datafusion:vortex-file-compressed 255800017 245435627 1.04
clickbench_q30/datafusion:vortex-file-compressed 🚨 286475981 227119708 1.26
clickbench_q31/datafusion:vortex-file-compressed 🚨 329628177 269571279 1.22
clickbench_q32/datafusion:vortex-file-compressed 1442181619 1314094895 1.10
clickbench_q33/datafusion:vortex-file-compressed 🚨 1606952735 1417906402 1.13
clickbench_q34/datafusion:vortex-file-compressed 🚨 1624441649 1410794265 1.15
clickbench_q35/datafusion:vortex-file-compressed 560812085 510472105 1.10
clickbench_q36/datafusion:vortex-file-compressed 88036415 81416362 1.08
clickbench_q37/datafusion:vortex-file-compressed 42367566 40389564 1.05
clickbench_q38/datafusion:vortex-file-compressed 23913446 23197133 1.03
clickbench_q39/datafusion:vortex-file-compressed 🚨 159917286 144976715 1.10
clickbench_q40/datafusion:vortex-file-compressed 🚨 21846472 18407628 1.19
clickbench_q41/datafusion:vortex-file-compressed 🚨 21247173 16905793 1.26
clickbench_q42/datafusion:vortex-file-compressed 🚨 20791468 18124427 1.15
datafusion / parquet (1.092x ➖, 0↑ 22↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚨 2060317 1775772 1.16
clickbench_q01/datafusion:parquet 21671153 22143595 0.98
clickbench_q02/datafusion:parquet 57463292 55109464 1.04
clickbench_q03/datafusion:parquet 45668096 44219826 1.03
clickbench_q04/datafusion:parquet 🚨 382855463 326160755 1.17
clickbench_q05/datafusion:parquet 🚨 418612877 360351699 1.16
clickbench_q06/datafusion:parquet 2057902 1968475 1.05
clickbench_q07/datafusion:parquet 28153433 25747427 1.09
clickbench_q08/datafusion:parquet 449568094 416290736 1.08
clickbench_q09/datafusion:parquet 🚨 720336207 644600383 1.12
clickbench_q10/datafusion:parquet 🚨 119930265 108170294 1.11
clickbench_q11/datafusion:parquet 🚨 148218556 132768174 1.12
clickbench_q12/datafusion:parquet 🚨 396721893 352632748 1.13
clickbench_q13/datafusion:parquet 🚨 569867442 498150617 1.14
clickbench_q14/datafusion:parquet 🚨 390838283 344332464 1.14
clickbench_q15/datafusion:parquet 🚨 421537530 367894587 1.15
clickbench_q16/datafusion:parquet 🚨 779438443 677358756 1.15
clickbench_q17/datafusion:parquet 🚨 747775920 668510099 1.12
clickbench_q18/datafusion:parquet 🚨 1567145387 1312022942 1.19
clickbench_q19/datafusion:parquet 33875422 33742010 1.00
clickbench_q20/datafusion:parquet 🚨 646221602 583494430 1.11
clickbench_q21/datafusion:parquet 🚨 724008267 635558084 1.14
clickbench_q22/datafusion:parquet 1031413700 950021746 1.09
clickbench_q23/datafusion:parquet 🚨 3966203538 3561844967 1.11
clickbench_q24/datafusion:parquet 🚨 92810122 83250271 1.11
clickbench_q25/datafusion:parquet 141778277 137659885 1.03
clickbench_q26/datafusion:parquet 92504184 85497395 1.08
clickbench_q27/datafusion:parquet 1111303276 1050658293 1.06
clickbench_q28/datafusion:parquet 6810710905 6497173356 1.05
clickbench_q29/datafusion:parquet 243923849 243345934 1.00
clickbench_q30/datafusion:parquet 🚨 404144852 359374850 1.12
clickbench_q31/datafusion:parquet 🚨 430576019 380399925 1.13
clickbench_q32/datafusion:parquet 1384652555 1285254290 1.08
clickbench_q33/datafusion:parquet 1639969471 1563271909 1.05
clickbench_q34/datafusion:parquet 1669660004 1526864715 1.09
clickbench_q35/datafusion:parquet 🚨 590657684 533374245 1.11
clickbench_q36/datafusion:parquet 🚨 161337360 141118057 1.14
clickbench_q37/datafusion:parquet 🚨 66594923 59920643 1.11
clickbench_q38/datafusion:parquet 100859523 93530309 1.08
clickbench_q39/datafusion:parquet 302070932 279958755 1.08
clickbench_q40/datafusion:parquet 36458702 33166917 1.10
clickbench_q41/datafusion:parquet 31696283 31544815 1.00
clickbench_q42/datafusion:parquet 32580353 32331942 1.01
duckdb / vortex-file-compressed (1.079x ➖, 3↑ 15↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚨 6974628 6088841 1.15
clickbench_q01/duckdb:vortex-file-compressed 🚨 15522851 13358538 1.16
clickbench_q02/duckdb:vortex-file-compressed 27708792 26222899 1.06
clickbench_q03/duckdb:vortex-file-compressed 30793607 29977903 1.03
clickbench_q04/duckdb:vortex-file-compressed 190878315 180931202 1.05
clickbench_q05/duckdb:vortex-file-compressed 215022832 196652032 1.09
clickbench_q06/duckdb:vortex-file-compressed 🚨 20113782 17553324 1.15
clickbench_q07/duckdb:vortex-file-compressed 🚨 19242281 14952365 1.29
clickbench_q08/duckdb:vortex-file-compressed 291352067 267555216 1.09
clickbench_q09/duckdb:vortex-file-compressed 368922012 350865984 1.05
clickbench_q10/duckdb:vortex-file-compressed 🚨 83980678 71682285 1.17
clickbench_q11/duckdb:vortex-file-compressed 🚨 95041195 81565772 1.17
clickbench_q12/duckdb:vortex-file-compressed 243645028 222984415 1.09
clickbench_q13/duckdb:vortex-file-compressed 🚨 485097655 437115097 1.11
clickbench_q14/duckdb:vortex-file-compressed 🚨 281799723 246481088 1.14
clickbench_q15/duckdb:vortex-file-compressed 231083617 217018178 1.06
clickbench_q16/duckdb:vortex-file-compressed 749478846 749204969 1.00
clickbench_q17/duckdb:vortex-file-compressed 593366971 557381522 1.06
clickbench_q18/duckdb:vortex-file-compressed 1286565764 1205094922 1.07
clickbench_q19/duckdb:vortex-file-compressed 22178629 21867244 1.01
clickbench_q20/duckdb:vortex-file-compressed 424361484 390713657 1.09
clickbench_q21/duckdb:vortex-file-compressed 432279745 413143577 1.05
clickbench_q22/duckdb:vortex-file-compressed 🚨 771296515 552422739 1.40
clickbench_q23/duckdb:vortex-file-compressed 🚨 1544163642 1322230850 1.17
clickbench_q24/duckdb:vortex-file-compressed 52622714 52900866 0.99
clickbench_q25/duckdb:vortex-file-compressed 🚨 93670596 77832969 1.20
clickbench_q26/duckdb:vortex-file-compressed 🚨 58188794 41421545 1.40
clickbench_q27/duckdb:vortex-file-compressed 🚨 574956965 507982592 1.13
clickbench_q28/duckdb:vortex-file-compressed 3125700068 2990670303 1.05
clickbench_q29/duckdb:vortex-file-compressed 30221835 29354934 1.03
clickbench_q30/duckdb:vortex-file-compressed 🚨 229560596 179012556 1.28
clickbench_q31/duckdb:vortex-file-compressed 🚨 318592896 254665868 1.25
clickbench_q32/duckdb:vortex-file-compressed 1467261135 1527082620 0.96
clickbench_q33/duckdb:vortex-file-compressed 1607151869 1506998742 1.07
clickbench_q34/duckdb:vortex-file-compressed 1594714937 1589685590 1.00
clickbench_q35/duckdb:vortex-file-compressed 390981934 379046375 1.03
clickbench_q36/duckdb:vortex-file-compressed 30530889 33379220 0.91
clickbench_q37/duckdb:vortex-file-compressed 🚀 21410402 25433292 0.84
clickbench_q38/duckdb:vortex-file-compressed 🚀 23751390 27315584 0.87
clickbench_q39/duckdb:vortex-file-compressed 46411791 45636275 1.02
clickbench_q40/duckdb:vortex-file-compressed 24463380 23825395 1.03
clickbench_q41/duckdb:vortex-file-compressed 23427883 23277700 1.01
clickbench_q42/duckdb:vortex-file-compressed 🚀 23481311 26489221 0.89
duckdb / parquet (1.055x ➖, 0↑ 4↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚨 260942068 220032681 1.19
clickbench_q01/duckdb:parquet 51711970 50520982 1.02
clickbench_q02/duckdb:parquet 69482418 66108214 1.05
clickbench_q03/duckdb:parquet 67001225 63381659 1.06
clickbench_q04/duckdb:parquet 218937014 202783354 1.08
clickbench_q05/duckdb:parquet 289512771 278811847 1.04
clickbench_q06/duckdb:parquet 62208175 61022096 1.02
clickbench_q07/duckdb:parquet 54316703 50494221 1.08
clickbench_q08/duckdb:parquet 284061469 268628384 1.06
clickbench_q09/duckdb:parquet 413581600 400377764 1.03
clickbench_q10/duckdb:parquet 103009109 95933921 1.07
clickbench_q11/duckdb:parquet 114645496 107707756 1.06
clickbench_q12/duckdb:parquet 🚨 330657435 294519656 1.12
clickbench_q13/duckdb:parquet 547881138 516634195 1.06
clickbench_q14/duckdb:parquet 340430833 331260418 1.03
clickbench_q15/duckdb:parquet 255070465 242046242 1.05
clickbench_q16/duckdb:parquet 666119003 614292829 1.08
clickbench_q17/duckdb:parquet 536308224 506002482 1.06
clickbench_q18/duckdb:parquet 1117788844 1050420228 1.06
clickbench_q19/duckdb:parquet 51633177 49596453 1.04
clickbench_q20/duckdb:parquet 447090620 434669939 1.03
clickbench_q21/duckdb:parquet 571437658 555651787 1.03
clickbench_q22/duckdb:parquet 952930683 933358865 1.02
clickbench_q23/duckdb:parquet 325650035 315013513 1.03
clickbench_q24/duckdb:parquet 81770878 79480978 1.03
clickbench_q25/duckdb:parquet 142189122 140471907 1.01
clickbench_q26/duckdb:parquet 55358229 52764494 1.05
clickbench_q27/duckdb:parquet 670904043 653148522 1.03
clickbench_q28/duckdb:parquet 4931110644 4835483530 1.02
clickbench_q29/duckdb:parquet 64708825 62255971 1.04
clickbench_q30/duckdb:parquet 319213787 306760390 1.04
clickbench_q31/duckdb:parquet 366022846 349197548 1.05
clickbench_q32/duckdb:parquet 1255155209 1150423615 1.09
clickbench_q33/duckdb:parquet 1363373978 1304472685 1.05
clickbench_q34/duckdb:parquet 1373315119 1334806552 1.03
clickbench_q35/duckdb:parquet 364330148 353648153 1.03
clickbench_q36/duckdb:parquet 69288578 64846942 1.07
clickbench_q37/duckdb:parquet 57036701 53184029 1.07
clickbench_q38/duckdb:parquet 61515668 59040276 1.04
clickbench_q39/duckdb:parquet 🚨 107965010 96291042 1.12
clickbench_q40/duckdb:parquet 58866189 54628997 1.08
clickbench_q41/duckdb:parquet 61357986 58452630 1.05
clickbench_q42/duckdb:parquet 🚨 55075148 49556700 1.11
duckdb / duckdb (1.009x ➖, 0↑ 3↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18330660 19938553 0.92
clickbench_q01/duckdb:duckdb 33298300 35359008 0.94
clickbench_q02/duckdb:duckdb 47014400 48125128 0.98
clickbench_q03/duckdb:duckdb 47916305 49059916 0.98
clickbench_q04/duckdb:duckdb 226004520 223889966 1.01
clickbench_q05/duckdb:duckdb 338648394 340879799 0.99
clickbench_q06/duckdb:duckdb 36282531 37949320 0.96
clickbench_q07/duckdb:duckdb 36960622 38253019 0.97
clickbench_q08/duckdb:duckdb 335365995 328897454 1.02
clickbench_q09/duckdb:duckdb 487987611 516718202 0.94
clickbench_q10/duckdb:duckdb 100709604 98501872 1.02
clickbench_q11/duckdb:duckdb 110703571 108475509 1.02
clickbench_q12/duckdb:duckdb 319726744 318327813 1.00
clickbench_q13/duckdb:duckdb 570825182 542394302 1.05
clickbench_q14/duckdb:duckdb 364191073 368736364 0.99
clickbench_q15/duckdb:duckdb 263738029 262133587 1.01
clickbench_q16/duckdb:duckdb 719078606 689691238 1.04
clickbench_q17/duckdb:duckdb 613780369 588158457 1.04
clickbench_q18/duckdb:duckdb 1335303904 1282122968 1.04
clickbench_q19/duckdb:duckdb 35569378 36551130 0.97
clickbench_q20/duckdb:duckdb 1064766281 972619852 1.09
clickbench_q21/duckdb:duckdb 1124040098 1110418501 1.01
clickbench_q22/duckdb:duckdb 🚨 1206694430 1016629473 1.19
clickbench_q23/duckdb:duckdb 266676737 254460558 1.05
clickbench_q24/duckdb:duckdb 61797044 63114400 0.98
clickbench_q25/duckdb:duckdb 125640895 125964438 1.00
clickbench_q26/duckdb:duckdb 57353036 58154578 0.99
clickbench_q27/duckdb:duckdb 1070733017 1043817041 1.03
clickbench_q28/duckdb:duckdb 4709962653 4675650632 1.01
clickbench_q29/duckdb:duckdb 49198143 51530930 0.95
clickbench_q30/duckdb:duckdb 302496202 285944322 1.06
clickbench_q31/duckdb:duckdb 446683371 418510458 1.07
clickbench_q32/duckdb:duckdb 1498974677 1390593872 1.08
clickbench_q33/duckdb:duckdb 🚨 2114346986 1916715701 1.10
clickbench_q34/duckdb:duckdb 🚨 2238096109 2022191941 1.11
clickbench_q35/duckdb:duckdb 271005052 265832467 1.02
clickbench_q36/duckdb:duckdb 43290754 40464093 1.07
clickbench_q37/duckdb:duckdb 31846710 34432538 0.92
clickbench_q38/duckdb:duckdb 31639390 33077336 0.96
clickbench_q39/duckdb:duckdb 64525055 65205488 0.99
clickbench_q40/duckdb:duckdb 32198168 33984720 0.95
clickbench_q41/duckdb:duckdb 31646785 32426538 0.98
clickbench_q42/duckdb:duckdb 32525878 34073798 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +15.7% +17.3% -1.3% +534.8% ➖ noise
0 duckdb:duckdb -8.1% +17.3% -21.6% +259.4% ➖ noise
0 duckdb:vortex-file-compressed +14.5% +17.3% -2.3% +306.4% ➖ noise
1 datafusion:vortex-file-compressed +10.9% +0.1% +10.8% +33.1% ➖ noise
1 duckdb:duckdb -5.8% +0.1% -5.9% +49.9% ➖ noise
1 duckdb:vortex-file-compressed +16.2% +0.1% +16.1% +18.1% ➖ noise
2 datafusion:vortex-file-compressed +7.8% +4.7% +2.9% +23.3% ➖ noise
2 duckdb:duckdb -2.3% +4.7% -6.7% +17.7% ➖ noise
2 duckdb:vortex-file-compressed +5.7% +4.7% +0.9% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +20.4% +4.5% +15.3% +141.5% ➖ noise
3 duckdb:duckdb -2.3% +4.5% -6.5% +35.9% ➖ noise
3 duckdb:vortex-file-compressed +2.7% +4.5% -1.7% +14.1% ➖ noise
4 datafusion:vortex-file-compressed +13.7% +12.6% +1.0% +10.0% ➖ noise
4 duckdb:duckdb +0.9% +12.6% -10.3% +10.0% ✅ faster
4 duckdb:vortex-file-compressed +5.5% +12.6% -6.3% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +12.8% +9.8% +2.7% +10.0% ➖ noise
5 duckdb:duckdb -0.7% +9.8% -9.5% +10.0% ✅ faster
5 duckdb:vortex-file-compressed +9.3% +9.8% -0.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -1.2% +3.2% -4.3% +39.1% ➖ noise
6 duckdb:duckdb -4.4% +3.2% -7.4% +27.2% ➖ noise
6 duckdb:vortex-file-compressed +14.6% +3.2% +11.0% +17.2% ➖ noise
7 datafusion:vortex-file-compressed +18.5% +8.5% +9.2% +13.6% ➖ noise
7 duckdb:duckdb -3.4% +8.5% -10.9% +12.6% ➖ noise
7 duckdb:vortex-file-compressed +28.7% +8.5% +18.7% +12.0% 🚨 regression
8 datafusion:vortex-file-compressed +15.9% +6.9% +8.5% +16.5% ➖ noise
8 duckdb:duckdb +2.0% +6.9% -4.6% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +8.9% +6.9% +1.9% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +16.2% +7.4% +8.2% +10.0% ➖ noise
9 duckdb:duckdb -5.6% +7.4% -12.1% +10.0% ✅ faster
9 duckdb:vortex-file-compressed +5.1% +7.4% -2.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +19.3% +9.1% +9.3% +10.0% ➖ noise
10 duckdb:duckdb +2.2% +9.1% -6.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +17.2% +9.1% +7.4% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +29.4% +9.0% +18.7% +11.6% 🚨 regression
11 duckdb:duckdb +2.1% +9.0% -6.4% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +16.5% +9.0% +6.9% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +20.5% +12.4% +7.2% +10.0% ➖ noise
12 duckdb:duckdb +0.4% +12.4% -10.6% +10.0% ✅ faster
12 duckdb:vortex-file-compressed +9.3% +12.4% -2.8% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +18.0% +10.1% +7.2% +10.0% ➖ noise
13 duckdb:duckdb +5.2% +10.1% -4.5% +11.0% ➖ noise
13 duckdb:vortex-file-compressed +11.0% +10.1% +0.8% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +22.3% +8.0% +13.3% +10.0% 🚨 regression
14 duckdb:duckdb -1.2% +8.0% -8.6% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +14.3% +8.0% +5.9% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +14.3% +9.9% +4.1% +10.0% ➖ noise
15 duckdb:duckdb +0.6% +9.9% -8.4% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +6.5% +9.9% -3.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +13.6% +11.7% +1.7% +10.0% ➖ noise
16 duckdb:duckdb +4.3% +11.7% -6.7% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +0.0% +11.7% -10.4% +12.4% ➖ noise
17 datafusion:vortex-file-compressed +15.0% +8.9% +5.6% +10.0% ➖ noise
17 duckdb:duckdb +4.4% +8.9% -4.2% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +6.5% +8.9% -2.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +17.2% +12.7% +4.0% +10.0% ➖ noise
18 duckdb:duckdb +4.1% +12.7% -7.6% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +6.8% +12.7% -5.3% +12.9% ➖ noise
19 datafusion:vortex-file-compressed +5.4% +2.2% +3.1% +18.5% ➖ noise
19 duckdb:duckdb -2.7% +2.2% -4.8% +11.2% ➖ noise
19 duckdb:vortex-file-compressed +1.4% +2.2% -0.8% +38.3% ➖ noise
20 datafusion:vortex-file-compressed +3.1% +6.7% -3.4% +192.2% ➖ noise
20 duckdb:duckdb +9.5% +6.7% +2.6% +20.7% ➖ noise
20 duckdb:vortex-file-compressed +8.6% +6.7% +1.8% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +10.5% +8.2% +2.1% +10.0% ➖ noise
21 duckdb:duckdb +1.2% +8.2% -6.5% +11.3% ➖ noise
21 duckdb:vortex-file-compressed +4.6% +8.2% -3.3% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +28.9% +5.3% +22.4% +10.0% 🚨 regression
22 duckdb:duckdb +18.7% +5.3% +12.7% +16.0% ➖ noise
22 duckdb:vortex-file-compressed +39.6% +5.3% +32.6% +18.2% 🚨 regression
23 datafusion:vortex-file-compressed +27.7% +7.3% +19.0% +41.1% ➖ noise
23 duckdb:duckdb +4.8% +7.3% -2.3% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +16.8% +7.3% +8.8% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +36.2% +7.1% +27.2% +15.8% 🚨 regression
24 duckdb:duckdb -2.1% +7.1% -8.6% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -0.5% +7.1% -7.1% +33.7% ➖ noise
25 datafusion:vortex-file-compressed +19.0% +2.1% +16.5% +11.6% 🚨 regression
25 duckdb:duckdb -0.3% +2.1% -2.3% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +20.3% +2.1% +17.9% +10.0% 🚨 regression
26 datafusion:vortex-file-compressed +35.2% +6.5% +26.9% +13.9% 🚨 regression
26 duckdb:duckdb -1.4% +6.5% -7.4% +10.0% ➖ noise
26 duckdb:vortex-file-compressed +40.5% +6.5% +31.9% +35.1% ➖ noise
27 datafusion:vortex-file-compressed +14.1% +4.2% +9.4% +10.0% ➖ noise
27 duckdb:duckdb +2.6% +4.2% -1.6% +12.4% ➖ noise
27 duckdb:vortex-file-compressed +13.2% +4.2% +8.6% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +4.5% +3.4% +1.1% +10.0% ➖ noise
28 duckdb:duckdb +0.7% +3.4% -2.6% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +4.5% +3.4% +1.1% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +4.2% +2.1% +2.1% +10.0% ➖ noise
29 duckdb:duckdb -4.5% +2.1% -6.5% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +3.0% +2.1% +0.9% +11.8% ➖ noise
30 datafusion:vortex-file-compressed +26.1% +8.2% +16.6% +10.0% 🚨 regression
30 duckdb:duckdb +5.8% +8.2% -2.2% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +28.2% +8.2% +18.5% +10.0% 🚨 regression
31 datafusion:vortex-file-compressed +22.3% +8.9% +12.3% +10.0% 🚨 regression
31 duckdb:duckdb +6.7% +8.9% -2.0% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +25.1% +8.9% +14.9% +10.0% 🚨 regression
32 datafusion:vortex-file-compressed +9.7% +8.4% +1.2% +13.3% ➖ noise
32 duckdb:duckdb +7.8% +8.4% -0.6% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -3.9% +8.4% -11.4% +10.0% ✅ faster
33 datafusion:vortex-file-compressed +13.3% +4.7% +8.2% +10.0% ➖ noise
33 duckdb:duckdb +10.3% +4.7% +5.3% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +6.6% +4.7% +1.8% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +15.1% +6.1% +8.6% +10.0% ➖ noise
34 duckdb:duckdb +10.7% +6.1% +4.3% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +0.3% +6.1% -5.4% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +9.9% +6.8% +2.9% +10.0% ➖ noise
35 duckdb:duckdb +1.9% +6.8% -4.6% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +3.1% +6.8% -3.4% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +8.1% +10.5% -2.2% +10.0% ➖ noise
36 duckdb:duckdb +7.0% +10.5% -3.2% +11.4% ➖ noise
36 duckdb:vortex-file-compressed -8.5% +10.5% -17.2% +11.2% ✅ faster
37 datafusion:vortex-file-compressed +4.9% +9.2% -3.9% +10.0% ➖ noise
37 duckdb:duckdb -7.5% +9.2% -15.3% +10.0% ✅ faster
37 duckdb:vortex-file-compressed -15.8% +9.2% -22.9% +10.7% ✅ faster
38 datafusion:vortex-file-compressed +3.1% +6.0% -2.7% +10.4% ➖ noise
38 duckdb:duckdb -4.3% +6.0% -9.8% +10.0% ✅ faster
38 duckdb:vortex-file-compressed -13.0% +6.0% -18.0% +10.0% ✅ faster
39 datafusion:vortex-file-compressed +10.3% +10.0% +0.3% +10.0% ➖ noise
39 duckdb:duckdb -1.0% +10.0% -10.0% +10.0% ✅ faster
39 duckdb:vortex-file-compressed +1.7% +10.0% -7.5% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +18.7% +8.8% +9.0% +10.0% ➖ noise
40 duckdb:duckdb -5.3% +8.8% -12.9% +10.0% ✅ faster
40 duckdb:vortex-file-compressed +2.7% +8.8% -5.7% +10.0% ➖ noise
41 datafusion:vortex-file-compressed +25.7% +2.7% +22.4% +10.0% 🚨 regression
41 duckdb:duckdb -2.4% +2.7% -5.0% +10.2% ➖ noise
41 duckdb:vortex-file-compressed +0.6% +2.7% -2.0% +10.0% ➖ noise
42 datafusion:vortex-file-compressed +14.7% +5.8% +8.4% +10.2% ➖ noise
42 duckdb:duckdb -4.5% +5.8% -9.8% +10.0% ✅ faster
42 duckdb:vortex-file-compressed -11.4% +5.8% -16.2% +10.0% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.03 GB → 7.03 GB (-0.0%)
  • vortex-file-compressed: 14.08 GB → 14.08 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +26.8%
Vortex (geomean): 1.353x ❌
Parquet (geomean): 1.067x ➖
Shifts: Parquet (control) +6.7% · Median polish +24.9%


datafusion / vortex-file-compressed (1.272x ➖, 0↑ 7↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 704152005 747116013 0.94
tpch_q02/datafusion:vortex-file-compressed 793518368 818443724 0.97
tpch_q03/datafusion:vortex-file-compressed 🚨 1291843359 932615590 1.39
tpch_q04/datafusion:vortex-file-compressed 703045093 582570583 1.21
tpch_q05/datafusion:vortex-file-compressed 1088373909 976220645 1.11
tpch_q06/datafusion:vortex-file-compressed 828596433 672322247 1.23
tpch_q07/datafusion:vortex-file-compressed 1369360464 1117257159 1.23
tpch_q08/datafusion:vortex-file-compressed 1310415075 1090320566 1.20
tpch_q09/datafusion:vortex-file-compressed 1689422619 1383344992 1.22
tpch_q10/datafusion:vortex-file-compressed 🚨 1797401092 1143194598 1.57
tpch_q11/datafusion:vortex-file-compressed 🚨 1067036998 478370573 2.23
tpch_q12/datafusion:vortex-file-compressed 🚨 1433486083 986520059 1.45
tpch_q13/datafusion:vortex-file-compressed 523161080 470661348 1.11
tpch_q14/datafusion:vortex-file-compressed 658367747 562451616 1.17
tpch_q15/datafusion:vortex-file-compressed 1226975681 1107686049 1.11
tpch_q16/datafusion:vortex-file-compressed 🚨 642022559 316539313 2.03
tpch_q17/datafusion:vortex-file-compressed 1173893277 1137206584 1.03
tpch_q18/datafusion:vortex-file-compressed 1249506556 1241419599 1.01
tpch_q19/datafusion:vortex-file-compressed 🚨 1108255740 706438445 1.57
tpch_q20/datafusion:vortex-file-compressed 🚨 1449084294 874051022 1.66
tpch_q21/datafusion:vortex-file-compressed 1977565893 1680152298 1.18
tpch_q22/datafusion:vortex-file-compressed 462265317 412337582 1.12
datafusion / vortex-compact (1.311x ❌, 0↑ 9↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 738817446 666413446 1.11
tpch_q02/datafusion:vortex-compact 🚨 1147681095 695991439 1.65
tpch_q03/datafusion:vortex-compact 988077523 827480877 1.19
tpch_q04/datafusion:vortex-compact 800331826 682491766 1.17
tpch_q05/datafusion:vortex-compact 1023122744 899406234 1.14
tpch_q06/datafusion:vortex-compact 822788389 637352156 1.29
tpch_q07/datafusion:vortex-compact 1240205950 1111629591 1.12
tpch_q08/datafusion:vortex-compact 1444077248 1135430392 1.27
tpch_q09/datafusion:vortex-compact 🚨 1639719455 1195761898 1.37
tpch_q10/datafusion:vortex-compact 🚨 1172399336 825206825 1.42
tpch_q11/datafusion:vortex-compact 535215977 479595570 1.12
tpch_q12/datafusion:vortex-compact 🚨 1206721012 776294571 1.55
tpch_q13/datafusion:vortex-compact 489951159 395888020 1.24
tpch_q14/datafusion:vortex-compact 🚨 815640528 565042451 1.44
tpch_q15/datafusion:vortex-compact 🚨 1443956847 1003987193 1.44
tpch_q16/datafusion:vortex-compact 🚨 942296653 363873270 2.59
tpch_q17/datafusion:vortex-compact 1513023616 1168254127 1.30
tpch_q18/datafusion:vortex-compact 1195926176 1073060924 1.11
tpch_q19/datafusion:vortex-compact 🚨 1060121262 763570185 1.39
tpch_q20/datafusion:vortex-compact 🚨 1163105785 853350915 1.36
tpch_q21/datafusion:vortex-compact 1649911018 1364184969 1.21
tpch_q22/datafusion:vortex-compact 427622524 441730527 0.97
datafusion / parquet (1.084x ➖, 0↑ 3↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 1289809015 812440242 1.59
tpch_q02/datafusion:parquet 🚨 1841544470 646008732 2.85
tpch_q03/datafusion:parquet 🚨 1978806701 951950620 2.08
tpch_q04/datafusion:parquet 583695153 528150906 1.11
tpch_q05/datafusion:parquet 1170295329 1219875441 0.96
tpch_q06/datafusion:parquet 495935113 484373903 1.02
tpch_q07/datafusion:parquet 1471271637 1281287289 1.15
tpch_q08/datafusion:parquet 1608873685 1673090678 0.96
tpch_q09/datafusion:parquet 1701749207 1846534613 0.92
tpch_q10/datafusion:parquet 1982390313 2368921039 0.84
tpch_q11/datafusion:parquet 538064948 690531719 0.78
tpch_q12/datafusion:parquet 837732348 719957317 1.16
tpch_q13/datafusion:parquet 753013654 769066547 0.98
tpch_q14/datafusion:parquet 788215776 815803389 0.97
tpch_q15/datafusion:parquet 1211725816 1256195519 0.96
tpch_q16/datafusion:parquet 389286315 395904873 0.98
tpch_q17/datafusion:parquet 1469416334 1421523462 1.03
tpch_q18/datafusion:parquet 1774003965 1448845861 1.22
tpch_q19/datafusion:parquet 1099732037 1032616864 1.06
tpch_q20/datafusion:parquet 1127659602 1503809083 0.75
tpch_q21/datafusion:parquet 1751382536 1660714242 1.05
tpch_q22/datafusion:parquet 684424196 882106357 0.78
duckdb / vortex-file-compressed (1.417x ❌, 0↑ 14↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 778764985 628359364 1.24
tpch_q02/duckdb:vortex-file-compressed 🚨 1599319294 1171732925 1.36
tpch_q03/duckdb:vortex-file-compressed 1174435406 1045349014 1.12
tpch_q04/duckdb:vortex-file-compressed 🚨 891270317 619980671 1.44
tpch_q05/duckdb:vortex-file-compressed 1405501736 1125179738 1.25
tpch_q06/duckdb:vortex-file-compressed 🚨 1208532776 796934391 1.52
tpch_q07/duckdb:vortex-file-compressed 🚨 2099207754 1085037521 1.93
tpch_q08/duckdb:vortex-file-compressed 1889593124 1609185966 1.17
tpch_q09/duckdb:vortex-file-compressed 🚨 2031160014 1539674118 1.32
tpch_q10/duckdb:vortex-file-compressed 🚨 1454593851 1114886545 1.30
tpch_q11/duckdb:vortex-file-compressed 784003340 621047150 1.26
tpch_q12/duckdb:vortex-file-compressed 🚨 1759929575 735835079 2.39
tpch_q13/duckdb:vortex-file-compressed 1061149614 945196027 1.12
tpch_q14/duckdb:vortex-file-compressed 🚨 1351434070 892796301 1.51
tpch_q15/duckdb:vortex-file-compressed 🚨 773004652 517656340 1.49
tpch_q16/duckdb:vortex-file-compressed 🚨 674596890 412014703 1.64
tpch_q17/duckdb:vortex-file-compressed 🚨 1672023796 1039051543 1.61
tpch_q18/duckdb:vortex-file-compressed 874373524 886487509 0.99
tpch_q19/duckdb:vortex-file-compressed 987618541 808695918 1.22
tpch_q20/duckdb:vortex-file-compressed 🚨 2259271451 1259194857 1.79
tpch_q21/duckdb:vortex-file-compressed 🚨 3259816540 1915665746 1.70
tpch_q22/duckdb:vortex-file-compressed 🚨 836290300 587441476 1.42
duckdb / vortex-compact (1.420x ❌, 0↑ 13↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨 791437528 582515214 1.36
tpch_q02/duckdb:vortex-compact 🚨 1458718360 1041446286 1.40
tpch_q03/duckdb:vortex-compact 1095991899 922690676 1.19
tpch_q04/duckdb:vortex-compact 🚨 774939274 441179908 1.76
tpch_q05/duckdb:vortex-compact 🚨 1322861468 964018339 1.37
tpch_q06/duckdb:vortex-compact 🚨 1152203108 798750724 1.44
tpch_q07/duckdb:vortex-compact 🚨 1983141794 951866407 2.08
tpch_q08/duckdb:vortex-compact 1718251147 1371787850 1.25
tpch_q09/duckdb:vortex-compact 1593305205 1320841049 1.21
tpch_q10/duckdb:vortex-compact 1237277695 1000790780 1.24
tpch_q11/duckdb:vortex-compact 717846217 663457622 1.08
tpch_q12/duckdb:vortex-compact 🚨 1414904485 630038437 2.25
tpch_q13/duckdb:vortex-compact 935486626 856348923 1.09
tpch_q14/duckdb:vortex-compact 🚨 1287752166 847149340 1.52
tpch_q15/duckdb:vortex-compact 🚨 786744896 530979670 1.48
tpch_q16/duckdb:vortex-compact 577270171 452953221 1.27
tpch_q17/duckdb:vortex-compact 🚨 1415142556 868343204 1.63
tpch_q18/duckdb:vortex-compact 693370746 657583891 1.05
tpch_q19/duckdb:vortex-compact 🚨 1178182686 726263004 1.62
tpch_q20/duckdb:vortex-compact 🚨 2259769332 1223930837 1.85
tpch_q21/duckdb:vortex-compact 🚨 2616042844 1710819831 1.53
tpch_q22/duckdb:vortex-compact 757900095 621819057 1.22
duckdb / parquet (1.051x ➖, 0↑ 1↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 1167679984 1002828504 1.16
tpch_q02/duckdb:parquet 1555688296 1440607868 1.08
tpch_q03/duckdb:parquet 1680547012 1758960711 0.96
tpch_q04/duckdb:parquet 🚨 1381865764 900975094 1.53
tpch_q05/duckdb:parquet 2088698220 2127659078 0.98
tpch_q06/duckdb:parquet 846836635 767240671 1.10
tpch_q07/duckdb:parquet 1955821696 2057385654 0.95
tpch_q08/duckdb:parquet 2520771942 2321799837 1.09
tpch_q09/duckdb:parquet 2504753989 2166968688 1.16
tpch_q10/duckdb:parquet 3271399222 3547025966 0.92
tpch_q11/duckdb:parquet 1039239093 956304677 1.09
tpch_q12/duckdb:parquet 1124680785 1225321516 0.92
tpch_q13/duckdb:parquet 1260585665 1192372360 1.06
tpch_q14/duckdb:parquet 1464041565 1256172420 1.17
tpch_q15/duckdb:parquet 898719251 888489573 1.01
tpch_q16/duckdb:parquet 749082987 864601310 0.87
tpch_q17/duckdb:parquet 1321308243 1512445837 0.87
tpch_q18/duckdb:parquet 1441155483 1283391997 1.12
tpch_q19/duckdb:parquet 1608590898 1463850798 1.10
tpch_q20/duckdb:parquet 1641310139 1713098329 0.96
tpch_q21/duckdb:parquet 2122783998 1911416284 1.11
tpch_q22/duckdb:parquet 1068741661 978030213 1.09
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +10.9% +36.0% -18.5% +72.0% ➖ noise
1 datafusion:vortex-file-compressed -5.8% +36.0% -30.7% +85.3% ➖ noise
1 duckdb:vortex-compact +35.9% +36.0% -0.1% +55.8% ➖ noise
1 duckdb:vortex-file-compressed +23.9% +36.0% -8.8% +55.8% ➖ noise
2 datafusion:vortex-compact +64.9% +75.5% -6.0% +76.8% ➖ noise
2 datafusion:vortex-file-compressed -3.0% +75.5% -44.7% +94.3% ➖ noise
2 duckdb:vortex-compact +40.1% +75.5% -20.2% +56.7% ➖ noise
2 duckdb:vortex-file-compressed +36.5% +75.5% -22.2% +64.4% ➖ noise
3 datafusion:vortex-compact +19.4% +40.9% -15.3% +90.7% ➖ noise
3 datafusion:vortex-file-compressed +38.5% +40.9% -1.7% +93.0% ➖ noise
3 duckdb:vortex-compact +18.8% +40.9% -15.7% +55.8% ➖ noise
3 duckdb:vortex-file-compressed +12.3% +40.9% -20.3% +61.7% ➖ noise
4 datafusion:vortex-compact +17.3% +30.2% -9.9% +55.8% ➖ noise
4 datafusion:vortex-file-compressed +20.7% +30.2% -7.3% +55.8% ➖ noise
4 duckdb:vortex-compact +75.7% +30.2% +34.9% +55.8% ➖ noise
4 duckdb:vortex-file-compressed +43.8% +30.2% +10.4% +55.8% ➖ noise
5 datafusion:vortex-compact +13.8% -3.0% +17.2% +55.8% ➖ noise
5 datafusion:vortex-file-compressed +11.5% -3.0% +14.9% +55.8% ➖ noise
5 duckdb:vortex-compact +37.2% -3.0% +41.4% +55.8% ➖ noise
5 duckdb:vortex-file-compressed +24.9% -3.0% +28.7% +55.8% ➖ noise
6 datafusion:vortex-compact +29.1% +6.3% +21.4% +55.8% ➖ noise
6 datafusion:vortex-file-compressed +23.2% +6.3% +15.9% +55.8% ➖ noise
6 duckdb:vortex-compact +44.3% +6.3% +35.7% +55.8% ➖ noise
6 duckdb:vortex-file-compressed +51.6% +6.3% +42.7% +55.8% ➖ noise
7 datafusion:vortex-compact +11.6% +4.5% +6.8% +55.8% ➖ noise
7 datafusion:vortex-file-compressed +22.6% +4.5% +17.3% +55.8% ➖ noise
7 duckdb:vortex-compact +108.3% +4.5% +99.4% +55.8% 🚨 regression
7 duckdb:vortex-file-compressed +93.5% +4.5% +85.2% +55.8% 🚨 regression
8 datafusion:vortex-compact +27.2% +2.2% +24.5% +55.8% ➖ noise
8 datafusion:vortex-file-compressed +20.2% +2.2% +17.6% +55.8% ➖ noise
8 duckdb:vortex-compact +25.3% +2.2% +22.6% +55.8% ➖ noise
8 duckdb:vortex-file-compressed +17.4% +2.2% +14.9% +55.8% ➖ noise
9 datafusion:vortex-compact +37.1% +3.2% +32.9% +55.8% ➖ noise
9 datafusion:vortex-file-compressed +22.1% +3.2% +18.3% +55.8% ➖ noise
9 duckdb:vortex-compact +20.6% +3.2% +16.9% +55.8% ➖ noise
9 duckdb:vortex-file-compressed +31.9% +3.2% +27.8% +55.8% ➖ noise
10 datafusion:vortex-compact +42.1% -12.1% +61.7% +55.8% 🚨 regression
10 datafusion:vortex-file-compressed +57.2% -12.1% +79.0% +55.8% 🚨 regression
10 duckdb:vortex-compact +23.6% -12.1% +40.7% +55.8% ➖ noise
10 duckdb:vortex-file-compressed +30.5% -12.1% +48.5% +55.8% ➖ noise
11 datafusion:vortex-compact +11.6% -8.0% +21.3% +55.8% ➖ noise
11 datafusion:vortex-file-compressed +123.1% -8.0% +142.4% +61.0% 🚨 regression
11 duckdb:vortex-compact +8.2% -8.0% +17.6% +55.8% ➖ noise
11 duckdb:vortex-file-compressed +26.2% -8.0% +37.2% +55.8% ➖ noise
12 datafusion:vortex-compact +55.4% +3.3% +50.4% +55.8% ➖ noise
12 datafusion:vortex-file-compressed +45.3% +3.3% +40.6% +55.8% ➖ noise
12 duckdb:vortex-compact +124.6% +3.3% +117.3% +123.8% ➖ noise
12 duckdb:vortex-file-compressed +139.2% +3.3% +131.4% +55.8% 🚨 regression
13 datafusion:vortex-compact +23.8% +1.7% +21.6% +79.7% ➖ noise
13 datafusion:vortex-file-compressed +11.2% +1.7% +9.3% +55.8% ➖ noise
13 duckdb:vortex-compact +9.2% +1.7% +7.4% +55.8% ➖ noise
13 duckdb:vortex-file-compressed +12.3% +1.7% +10.3% +55.8% ➖ noise
14 datafusion:vortex-compact +44.4% +6.1% +36.0% +55.8% ➖ noise
14 datafusion:vortex-file-compressed +17.1% +6.1% +10.3% +55.8% ➖ noise
14 duckdb:vortex-compact +52.0% +6.1% +43.2% +55.8% ➖ noise
14 duckdb:vortex-file-compressed +51.4% +6.1% +42.6% +55.8% ➖ noise
15 datafusion:vortex-compact +43.8% -1.2% +45.6% +55.8% ➖ noise
15 datafusion:vortex-file-compressed +10.8% -1.2% +12.1% +55.8% ➖ noise
15 duckdb:vortex-compact +48.2% -1.2% +50.0% +55.8% ➖ noise
15 duckdb:vortex-file-compressed +49.3% -1.2% +51.2% +55.8% ➖ noise
16 datafusion:vortex-compact +159.0% -7.7% +180.6% +55.8% 🚨 regression
16 datafusion:vortex-file-compressed +102.8% -7.7% +119.7% +55.8% 🚨 regression
16 duckdb:vortex-compact +27.4% -7.7% +38.1% +55.8% ➖ noise
16 duckdb:vortex-file-compressed +63.7% -7.7% +77.4% +55.8% 🚨 regression
17 datafusion:vortex-compact +29.5% -5.0% +36.3% +55.8% ➖ noise
17 datafusion:vortex-file-compressed +3.2% -5.0% +8.6% +55.8% ➖ noise
17 duckdb:vortex-compact +63.0% -5.0% +71.5% +55.8% 🚨 regression
17 duckdb:vortex-file-compressed +60.9% -5.0% +69.3% +55.8% 🚨 regression
18 datafusion:vortex-compact +11.4% +17.3% -5.0% +55.8% ➖ noise
18 datafusion:vortex-file-compressed +0.7% +17.3% -14.2% +55.8% ➖ noise
18 duckdb:vortex-compact +5.4% +17.3% -10.1% +55.8% ➖ noise
18 duckdb:vortex-file-compressed -1.4% +17.3% -15.9% +55.8% ➖ noise
19 datafusion:vortex-compact +38.8% +8.2% +28.3% +55.8% ➖ noise
19 datafusion:vortex-file-compressed +56.9% +8.2% +45.0% +55.8% ➖ noise
19 duckdb:vortex-compact +62.2% +8.2% +50.0% +55.8% ➖ noise
19 duckdb:vortex-file-compressed +22.1% +8.2% +12.9% +55.8% ➖ noise
20 datafusion:vortex-compact +36.3% -15.2% +60.8% +55.8% 🚨 regression
20 datafusion:vortex-file-compressed +65.8% -15.2% +95.6% +55.8% 🚨 regression
20 duckdb:vortex-compact +84.6% -15.2% +117.8% +55.8% 🚨 regression
20 duckdb:vortex-file-compressed +79.4% -15.2% +111.7% +55.8% 🚨 regression
21 datafusion:vortex-compact +20.9% +8.2% +11.8% +55.8% ➖ noise
21 datafusion:vortex-file-compressed +17.7% +8.2% +8.8% +55.8% ➖ noise
21 duckdb:vortex-compact +52.9% +8.2% +41.3% +55.8% ➖ noise
21 duckdb:vortex-file-compressed +70.2% +8.2% +57.2% +55.8% 🚨 regression
22 datafusion:vortex-compact -3.2% -7.9% +5.1% +60.0% ➖ noise
22 datafusion:vortex-file-compressed +12.1% -7.9% +21.8% +55.8% ➖ noise
22 duckdb:vortex-compact +21.9% -7.9% +32.4% +55.8% ➖ noise
22 duckdb:vortex-file-compressed +42.4% -7.9% +54.6% +55.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: Compression

Vortex (geomean): 1.016x ➖
Parquet (geomean): 1.008x ➖


unknown / unknown (1.011x ➖, 0↑ 2↓)
name PR 1ac4f14 (ns) base a78897f (ns) ratio (PR/base)
compress time/Arade 1158913320 1153141938 1.01
compress time/Bimbo 7045088356 7082518749 0.99
compress time/CMSprovider 2964692918 2894328411 1.02
compress time/Euro2016 434820203 419243658 1.04
compress time/Food 363814616 393414478 0.92
compress time/HashTags 814330342 802732811 1.01
compress time/TPC-H l_comment canonical 1284228026 1288181709 1.00
compress time/TPC-H l_comment chunked 1302820534 1299438552 1.00
compress time/taxi 718235066 715101617 1.00
compress time/wide table cols=100 chunks=1 rows=1000 14545508 13989383 1.04
compress time/wide table cols=100 chunks=50 rows=1000 13077231 12326123 1.06
compress time/wide table cols=1000 chunks=1 rows=1000 132109577 133897337 0.99
compress time/wide table cols=1000 chunks=50 rows=1000 141746120 139233139 1.02
compress time/wide table cols=10000 chunks=1 rows=1000 1418993391 1408786470 1.01
compress time/wide table cols=10000 chunks=50 rows=1000 1422571258 1410612151 1.01
decompress time/Arade 31379973 31559236 0.99
decompress time/Bimbo 115630308 115886685 1.00
decompress time/CMSprovider 90400176 84829919 1.07
decompress time/Euro2016 🚨 28584600 21110146 1.35
decompress time/Food 9379838 9074840 1.03
decompress time/HashTags 85841018 78939859 1.09
decompress time/TPC-H l_comment canonical 43637409 40857385 1.07
decompress time/TPC-H l_comment chunked 42546414 40534439 1.05
decompress time/taxi 21359164 20749874 1.03
decompress time/wide table cols=100 chunks=1 rows=1000 2583283 2583250 1.00
decompress time/wide table cols=100 chunks=50 rows=1000 2590830 2629461 0.99
decompress time/wide table cols=1000 chunks=1 rows=1000 21737216 22438357 0.97
decompress time/wide table cols=1000 chunks=50 rows=1000 22138831 21943640 1.01
decompress time/wide table cols=10000 chunks=1 rows=1000 234581886 226832664 1.03
decompress time/wide table cols=10000 chunks=50 rows=1000 229786817 224528008 1.02
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 3103746773 3042816161 1.02
parquet_rs-zstd compress time/Bimbo 17187828094 17183557040 1.00
parquet_rs-zstd compress time/CMSprovider 7751037575 7696189046 1.01
parquet_rs-zstd compress time/Euro2016 1346263697 1361168749 0.99
parquet_rs-zstd compress time/Food 928929780 932480864 1.00
parquet_rs-zstd compress time/HashTags 2479370494 2480385241 1.00
parquet_rs-zstd compress time/TPC-H l_comment canonical 3115838850 3069903787 1.01
parquet_rs-zstd compress time/TPC-H l_comment chunked 3098832139 3076462892 1.01
parquet_rs-zstd compress time/taxi 1513636963 1510329287 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6965836 6729694 1.04
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6828170 6687449 1.02
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 82289356 86351302 0.95
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 81711043 85345595 0.96
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 883526213 895249527 0.99
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 869401689 918120289 0.95
parquet_rs-zstd decompress time/Arade 646571796 644964882 1.00
parquet_rs-zstd decompress time/Bimbo 1726004293 1735964295 0.99
parquet_rs-zstd decompress time/CMSprovider 1927747061 1933043581 1.00
parquet_rs-zstd decompress time/Euro2016 392027496 391114477 1.00
parquet_rs-zstd decompress time/Food 219872628 221672312 0.99
parquet_rs-zstd decompress time/HashTags 634390197 634249636 1.00
parquet_rs-zstd decompress time/TPC-H l_comment canonical 562034076 561353301 1.00
parquet_rs-zstd decompress time/TPC-H l_comment chunked 563067003 560079315 1.01
parquet_rs-zstd decompress time/taxi 246606665 246655048 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2655196 2723847 0.97
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2649522 2646216 1.00
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 31057597 32876399 0.94
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 31076871 32162810 0.97
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 367346920 372212997 0.99
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 370599003 376316097 0.98
vortex-file-compressed size/Arade 143387364 143387364 1.00
vortex-file-compressed size/Bimbo 457703724 457703724 1.00
vortex-file-compressed size/CMSprovider 422230580 422230580 1.00
vortex-file-compressed size/Euro2016 164460292 164454716 1.00
vortex-file-compressed size/Food 42374576 42374576 1.00
vortex-file-compressed size/HashTags 195767892 195767892 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179471576 179471576 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179471576 179471576 1.00
vortex-file-compressed size/taxi 50083652 50083652 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 876416 876416 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 876416 876416 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8749616 8749616 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8749616 8749616 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 87517616 87517616 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 87517616 87517616 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.99
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.99
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.02
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.05
vortex:parquet-zstd ratio compress time/Food 0 0 0.93
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.98
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.00
vortex:parquet-zstd ratio compress time/taxi 0 0 1.00
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 2 2 1.00
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 1.04
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.04
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.06
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.06
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.99
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.00
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.07
vortex:parquet-zstd ratio decompress time/Euro2016 🚨 0 0 1.35
vortex:parquet-zstd ratio decompress time/Food 0 0 1.04
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.09
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.07
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.04
vortex:parquet-zstd ratio decompress time/taxi 0 0 1.03
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.03
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.03
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.04
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 10, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants