Skip to content

Use Uint8 for GT field in statpopgen instead of UInt64#8050

Open
myrrc wants to merge 1 commit into
developfrom
myrrc/statpopgen-u8
Open

Use Uint8 for GT field in statpopgen instead of UInt64#8050
myrrc wants to merge 1 commit into
developfrom
myrrc/statpopgen-u8

Conversation

@myrrc
Copy link
Copy Markdown
Contributor

@myrrc myrrc commented May 21, 2026

With current U64 we're mostly measuring Duckdb upcast performance.
list_sum(GT) upcasts GT to u128 which takes most CPU time.
Since GT can fit in U8, use this to measure our performance.

@myrrc myrrc requested a review from a team May 21, 2026 16:51
@myrrc myrrc added action/benchmark-sql Trigger SQL benchmarks to run on this PR changelog/chore A trivial change labels May 21, 2026
Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label May 21, 2026
@myrrc myrrc force-pushed the myrrc/statpopgen-u8 branch from 54ef201 to 340e387 Compare May 21, 2026 16:51
@myrrc myrrc requested a review from a team May 21, 2026 16:52
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 21, 2026

Merging this PR will not alter performance

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 1 improved benchmark
❌ 2 regressed benchmarks
✅ 1234 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation chunked_varbinview_canonical_into[(100, 100)] 307.9 µs 273.2 µs +12.73%
Simulation new_alp_prim_test_between[f32, 16384] 104.6 µs 119.1 µs -12.17%
Simulation new_alp_prim_test_between[f32, 32768] 154 µs 182.9 µs -15.79%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing myrrc/statpopgen-u8 (340e387) with develop (f852d72)

Open in CodSpeed

@myrrc myrrc added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label May 21, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label May 21, 2026
@myrrc myrrc enabled auto-merge (squash) May 21, 2026 16:54
@github-actions
Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark Statistical and Population Genetics failed! Check the workflow run for details.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 21, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 340e387 1 Explore Profiling Data

Powered by Polar Signals Cloud

Copy link
Copy Markdown
Contributor

@joseph-isaacs joseph-isaacs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lets audit all the fields

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.980x ➖


datafusion / vortex-file-compressed (0.980x ➖, 0↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 118489363 116586569 1.02
polarsignals_q01/datafusion:vortex-file-compressed 258840865 286380642 0.90
polarsignals_q02/datafusion:vortex-file-compressed 22379715 23073307 0.97
polarsignals_q03/datafusion:vortex-file-compressed 289816394 281841044 1.03
polarsignals_q04/datafusion:vortex-file-compressed 11523079 11508230 1.00
polarsignals_q05/datafusion:vortex-file-compressed 15700890 15135067 1.04
polarsignals_q06/datafusion:vortex-file-compressed 18004742 17992649 1.00
polarsignals_q07/datafusion:vortex-file-compressed 12317396 13453423 0.92
polarsignals_q08/datafusion:vortex-file-compressed 409811063 405730573 1.01
polarsignals_q09/datafusion:vortex-file-compressed 10165656 10979334 0.93

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 689.41 MB 689.41 MB 32 B -0.0%

Totals:

  • vortex-file-compressed: 689.41 MB → 689.41 MB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.1%
Vortex (geomean): 0.899x ✅
Parquet (geomean): 0.872x ✅
Shifts: Parquet (control) -12.8% · Median polish -11.7%


datafusion / vortex-file-compressed (0.881x ✅, 6↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 4817935 6068122 0.79
fineweb_q01/datafusion:vortex-file-compressed 🚀 19997534 23343364 0.86
fineweb_q02/datafusion:vortex-file-compressed 🚀 21768394 25334236 0.86
fineweb_q03/datafusion:vortex-file-compressed 🚀 74280541 86202639 0.86
fineweb_q04/datafusion:vortex-file-compressed 228022608 240855487 0.95
fineweb_q05/datafusion:vortex-file-compressed 213822260 226761978 0.94
fineweb_q06/datafusion:vortex-file-compressed 🚀 50124726 59259865 0.85
fineweb_q07/datafusion:vortex-file-compressed 🚀 54814054 62786542 0.87
fineweb_q08/datafusion:vortex-file-compressed 22355188 23171748 0.96
datafusion / vortex-compact (0.887x ✅, 7↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 5919108 6630094 0.89
fineweb_q01/datafusion:vortex-compact 🚀 95113927 106411386 0.89
fineweb_q02/datafusion:vortex-compact 106018682 116841779 0.91
fineweb_q03/datafusion:vortex-compact 🚀 869630505 988644131 0.88
fineweb_q04/datafusion:vortex-compact 🚀 902730916 1033854824 0.87
fineweb_q05/datafusion:vortex-compact 🚀 819943448 939182170 0.87
fineweb_q06/datafusion:vortex-compact 🚀 459632515 526660624 0.87
fineweb_q07/datafusion:vortex-compact 🚀 468301131 543174113 0.86
fineweb_q08/datafusion:vortex-compact 18377573 19713412 0.93
datafusion / parquet (0.867x ✅, 9↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 6356642 7950422 0.80
fineweb_q01/datafusion:parquet 🚀 293968539 332844533 0.88
fineweb_q02/datafusion:parquet 🚀 293005363 335769452 0.87
fineweb_q03/datafusion:parquet 🚀 292758291 328776697 0.89
fineweb_q04/datafusion:parquet 🚀 303505404 343542120 0.88
fineweb_q05/datafusion:parquet 🚀 298972486 346160181 0.86
fineweb_q06/datafusion:parquet 🚀 290507665 331460461 0.88
fineweb_q07/datafusion:parquet 🚀 282554713 324430002 0.87
fineweb_q08/datafusion:parquet 🚀 281943841 324669500 0.87
duckdb / vortex-file-compressed (0.927x ➖, 3↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 3509777 4058460 0.86
fineweb_q01/duckdb:vortex-file-compressed 24393096 24789824 0.98
fineweb_q02/duckdb:vortex-file-compressed 24996327 26520469 0.94
fineweb_q03/duckdb:vortex-file-compressed 116100061 124113609 0.94
fineweb_q04/duckdb:vortex-file-compressed 223215709 237125916 0.94
fineweb_q05/duckdb:vortex-file-compressed 207283146 221137905 0.94
fineweb_q06/duckdb:vortex-file-compressed 🚀 51866295 59603920 0.87
fineweb_q07/duckdb:vortex-file-compressed 🚀 55016282 61946421 0.89
fineweb_q08/duckdb:vortex-file-compressed 23805037 24181032 0.98
duckdb / vortex-compact (0.901x ➖, 6↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚀 4149573 4864450 0.85
fineweb_q01/duckdb:vortex-compact 107240666 113986889 0.94
fineweb_q02/duckdb:vortex-compact 112799524 125278307 0.90
fineweb_q03/duckdb:vortex-compact 🚀 863708358 973954205 0.89
fineweb_q04/duckdb:vortex-compact 🚀 895779328 1017734301 0.88
fineweb_q05/duckdb:vortex-compact 🚀 803685628 909760521 0.88
fineweb_q06/duckdb:vortex-compact 🚀 459605264 511733608 0.90
fineweb_q07/duckdb:vortex-compact 🚀 477072679 543319118 0.88
fineweb_q08/duckdb:vortex-compact 21243513 21250117 1.00
duckdb / parquet (0.877x ✅, 8↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 31565185 34539959 0.91
fineweb_q01/duckdb:parquet 🚀 83690956 96726088 0.87
fineweb_q02/duckdb:parquet 🚀 84840416 97382925 0.87
fineweb_q03/duckdb:parquet 🚀 316973206 357055460 0.89
fineweb_q04/duckdb:parquet 🚀 445540533 502091487 0.89
fineweb_q05/duckdb:parquet 🚀 414601621 464462228 0.89
fineweb_q06/duckdb:parquet 🚀 202982809 228419025 0.89
fineweb_q07/duckdb:parquet 🚀 215138836 243650821 0.88
fineweb_q08/duckdb:parquet 🚀 32690659 40464238 0.81
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -10.7% -14.5% +4.4% +49.8% ➖ noise
0 datafusion:vortex-file-compressed -20.6% -14.5% -7.1% +52.1% ➖ noise
0 duckdb:vortex-compact -14.7% -14.5% -0.2% +48.2% ➖ noise
0 duckdb:vortex-file-compressed -13.5% -14.5% +1.2% +77.8% ➖ noise
1 datafusion:vortex-compact -10.6% -12.6% +2.2% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -14.3% -12.6% -2.0% +19.2% ➖ noise
1 duckdb:vortex-compact -5.9% -12.6% +7.6% +23.1% ➖ noise
1 duckdb:vortex-file-compressed -1.6% -12.6% +12.6% +59.7% ➖ noise
2 datafusion:vortex-compact -9.3% -12.8% +4.1% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -14.1% -12.8% -1.5% +14.4% ➖ noise
2 duckdb:vortex-compact -10.0% -12.8% +3.3% +18.0% ➖ noise
2 duckdb:vortex-file-compressed -5.7% -12.8% +8.1% +14.1% ➖ noise
3 datafusion:vortex-compact -12.0% -11.1% -1.1% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -13.8% -11.1% -3.1% +33.0% ➖ noise
3 duckdb:vortex-compact -11.3% -11.1% -0.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -6.5% -11.1% +5.2% +34.9% ➖ noise
4 datafusion:vortex-compact -12.7% -11.5% -1.4% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -5.3% -11.5% +6.9% +10.0% ➖ noise
4 duckdb:vortex-compact -12.0% -11.5% -0.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -5.9% -11.5% +6.3% +10.0% ➖ noise
5 datafusion:vortex-compact -12.7% -12.2% -0.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -5.7% -12.2% +7.4% +10.0% ➖ noise
5 duckdb:vortex-compact -11.7% -12.2% +0.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -6.3% -12.2% +6.8% +10.0% ➖ noise
6 datafusion:vortex-compact -12.7% -11.7% -1.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -15.4% -11.7% -4.2% +11.8% ➖ noise
6 duckdb:vortex-compact -10.2% -11.7% +1.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -13.0% -11.7% -1.4% +10.0% ➖ noise
7 datafusion:vortex-compact -13.8% -12.3% -1.7% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -12.7% -12.3% -0.4% +10.6% ➖ noise
7 duckdb:vortex-compact -12.2% -12.3% +0.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -11.2% -12.3% +1.3% +13.7% ➖ noise
8 datafusion:vortex-compact -6.8% -16.2% +11.3% +16.8% ➖ noise
8 datafusion:vortex-file-compressed -3.5% -16.2% +15.2% +14.8% 🚨 regression
8 duckdb:vortex-compact -0.0% -16.2% +19.4% +16.0% 🚨 regression
8 duckdb:vortex-file-compressed -1.6% -16.2% +17.5% +10.0% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

File Size Changes (2 files changed, -0.0% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.79 GB 1.79 GB 32 B -0.0%
sample.vortex 1.0 vortex-compact 1.23 GB 1.23 GB 32 B -0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (-0.0%)
  • vortex-file-compressed: 1.79 GB → 1.79 GB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Vortex (geomean): 0.987x ➖
Parquet (geomean): 0.979x ➖
Shifts: Parquet (control) -2.1% · Median polish -1.4%


datafusion / vortex-file-compressed (0.987x ➖, 0↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 49810408 49455624 1.01
tpch_q02/datafusion:vortex-file-compressed 21673286 22262995 0.97
tpch_q03/datafusion:vortex-file-compressed 29044191 28283891 1.03
tpch_q04/datafusion:vortex-file-compressed 20380137 20107562 1.01
tpch_q05/datafusion:vortex-file-compressed 47385703 48218926 0.98
tpch_q06/datafusion:vortex-file-compressed 9773263 10616468 0.92
tpch_q07/datafusion:vortex-file-compressed 53302768 54804652 0.97
tpch_q08/datafusion:vortex-file-compressed 39295293 39051968 1.01
tpch_q09/datafusion:vortex-file-compressed 50952521 52264702 0.97
tpch_q10/datafusion:vortex-file-compressed 39373928 38929033 1.01
tpch_q11/datafusion:vortex-file-compressed 15450747 16391445 0.94
tpch_q12/datafusion:vortex-file-compressed 23737086 23727233 1.00
tpch_q13/datafusion:vortex-file-compressed 24663161 25347475 0.97
tpch_q14/datafusion:vortex-file-compressed 15698936 15549685 1.01
tpch_q15/datafusion:vortex-file-compressed 24206735 24481059 0.99
tpch_q16/datafusion:vortex-file-compressed 18978385 19135159 0.99
tpch_q17/datafusion:vortex-file-compressed 66351958 69725975 0.95
tpch_q18/datafusion:vortex-file-compressed 79042241 81981732 0.96
tpch_q19/datafusion:vortex-file-compressed 19977792 20230279 0.99
tpch_q20/datafusion:vortex-file-compressed 29336260 28601353 1.03
tpch_q21/datafusion:vortex-file-compressed 69880510 70846077 0.99
tpch_q22/datafusion:vortex-file-compressed 12658958 12450338 1.02
datafusion / vortex-compact (0.976x ➖, 0↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 58611905 57483828 1.02
tpch_q02/datafusion:vortex-compact 25390369 25821067 0.98
tpch_q03/datafusion:vortex-compact 28990355 29163633 0.99
tpch_q04/datafusion:vortex-compact 22040111 23239884 0.95
tpch_q05/datafusion:vortex-compact 49302135 51274349 0.96
tpch_q06/datafusion:vortex-compact 12334163 12773656 0.97
tpch_q07/datafusion:vortex-compact 57695841 57786685 1.00
tpch_q08/datafusion:vortex-compact 42253664 43436896 0.97
tpch_q09/datafusion:vortex-compact 55229533 55167118 1.00
tpch_q10/datafusion:vortex-compact 44658623 45922708 0.97
tpch_q11/datafusion:vortex-compact 16250016 17701753 0.92
tpch_q12/datafusion:vortex-compact 30096225 31356427 0.96
tpch_q13/datafusion:vortex-compact 31292756 31929005 0.98
tpch_q14/datafusion:vortex-compact 18782301 19023321 0.99
tpch_q15/datafusion:vortex-compact 30228107 31131959 0.97
tpch_q16/datafusion:vortex-compact 23702870 23948184 0.99
tpch_q17/datafusion:vortex-compact 68008888 70742985 0.96
tpch_q18/datafusion:vortex-compact 82014390 83147590 0.99
tpch_q19/datafusion:vortex-compact 29697328 30139882 0.99
tpch_q20/datafusion:vortex-compact 32788926 34471373 0.95
tpch_q21/datafusion:vortex-compact 74153352 74759246 0.99
tpch_q22/datafusion:vortex-compact 12599279 12844579 0.98
datafusion / parquet (0.963x ➖, 3↑ 1↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 99400970 132470140 0.75
tpch_q02/datafusion:parquet 59830532 60351043 0.99
tpch_q03/datafusion:parquet 70783480 73118921 0.97
tpch_q04/datafusion:parquet 42435386 43378078 0.98
tpch_q05/datafusion:parquet 91719704 93146247 0.98
tpch_q06/datafusion:parquet 🚀 35926875 42308673 0.85
tpch_q07/datafusion:parquet 103071864 105091933 0.98
tpch_q08/datafusion:parquet 88475061 90541919 0.98
tpch_q09/datafusion:parquet 125244947 125655719 1.00
tpch_q10/datafusion:parquet 108424921 110261590 0.98
tpch_q11/datafusion:parquet 40167593 39727049 1.01
tpch_q12/datafusion:parquet 73618248 81241584 0.91
tpch_q13/datafusion:parquet 193221189 197221017 0.98
tpch_q14/datafusion:parquet 44503749 46434065 0.96
tpch_q15/datafusion:parquet 60067542 57899210 1.04
tpch_q16/datafusion:parquet 39566788 39984427 0.99
tpch_q17/datafusion:parquet 🚀 122033185 137725205 0.89
tpch_q18/datafusion:parquet 163025774 161162036 1.01
tpch_q19/datafusion:parquet 🚨 70960883 63445046 1.12
tpch_q20/datafusion:parquet 68279196 68937786 0.99
tpch_q21/datafusion:parquet 126725908 134190423 0.94
tpch_q22/datafusion:parquet 29843125 31268374 0.95
datafusion / arrow (0.990x ➖, 0↑ 1↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 56365187 53017221 1.06
tpch_q02/datafusion:arrow 18664611 19566789 0.95
tpch_q03/datafusion:arrow 29199760 28940217 1.01
tpch_q04/datafusion:arrow 25113261 24972196 1.01
tpch_q05/datafusion:arrow 🚨 83578121 73519452 1.14
tpch_q06/datafusion:arrow 20317346 19684909 1.03
tpch_q07/datafusion:arrow 101687098 102675793 0.99
tpch_q08/datafusion:arrow 41863832 43846712 0.95
tpch_q09/datafusion:arrow 62493019 67076637 0.93
tpch_q10/datafusion:arrow 44660522 49231387 0.91
tpch_q11/datafusion:arrow 8970069 9224261 0.97
tpch_q12/datafusion:arrow 49708382 51146809 0.97
tpch_q13/datafusion:arrow 46300181 47052749 0.98
tpch_q14/datafusion:arrow 20932066 21589749 0.97
tpch_q15/datafusion:arrow 40775786 41699256 0.98
tpch_q16/datafusion:arrow 18353020 18602725 0.99
tpch_q17/datafusion:arrow 66375812 68422001 0.97
tpch_q18/datafusion:arrow 133935552 132550182 1.01
tpch_q19/datafusion:arrow 34137549 34627118 0.99
tpch_q20/datafusion:arrow 33462149 33783517 0.99
tpch_q21/datafusion:arrow 148870053 143200350 1.04
tpch_q22/datafusion:arrow 17147583 17733551 0.97
duckdb / vortex-file-compressed (0.996x ➖, 0↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 32097542 31438849 1.02
tpch_q02/duckdb:vortex-file-compressed 25382867 24948245 1.02
tpch_q03/duckdb:vortex-file-compressed 33438470 33132279 1.01
tpch_q04/duckdb:vortex-file-compressed 29076271 29507749 0.99
tpch_q05/duckdb:vortex-file-compressed 37634527 37381106 1.01
tpch_q06/duckdb:vortex-file-compressed 8571644 8174178 1.05
tpch_q07/duckdb:vortex-file-compressed 34464424 35499796 0.97
tpch_q08/duckdb:vortex-file-compressed 36983657 37907335 0.98
tpch_q09/duckdb:vortex-file-compressed 57615946 57695188 1.00
tpch_q10/duckdb:vortex-file-compressed 40315899 40918261 0.99
tpch_q11/duckdb:vortex-file-compressed 15045536 14819621 1.02
tpch_q12/duckdb:vortex-file-compressed 22213354 22481603 0.99
tpch_q13/duckdb:vortex-file-compressed 37381851 37490421 1.00
tpch_q14/duckdb:vortex-file-compressed 22679045 22264554 1.02
tpch_q15/duckdb:vortex-file-compressed 16946914 17307712 0.98
tpch_q16/duckdb:vortex-file-compressed 28862665 29976317 0.96
tpch_q17/duckdb:vortex-file-compressed 24635206 23912512 1.03
tpch_q18/duckdb:vortex-file-compressed 52071632 52165973 1.00
tpch_q19/duckdb:vortex-file-compressed 28439354 29891431 0.95
tpch_q20/duckdb:vortex-file-compressed 33407135 33659296 0.99
tpch_q21/duckdb:vortex-file-compressed 98369559 99845451 0.99
tpch_q22/duckdb:vortex-file-compressed 16606567 16971468 0.98
duckdb / vortex-compact (0.988x ➖, 0↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 37883608 38007027 1.00
tpch_q02/duckdb:vortex-compact 33903066 34698538 0.98
tpch_q03/duckdb:vortex-compact 34859395 34693219 1.00
tpch_q04/duckdb:vortex-compact 31531155 31800801 0.99
tpch_q05/duckdb:vortex-compact 40102503 40670659 0.99
tpch_q06/duckdb:vortex-compact 10691284 11597165 0.92
tpch_q07/duckdb:vortex-compact 40052204 40892639 0.98
tpch_q08/duckdb:vortex-compact 41771201 41429568 1.01
tpch_q09/duckdb:vortex-compact 66942753 65194382 1.03
tpch_q10/duckdb:vortex-compact 44847941 45701618 0.98
tpch_q11/duckdb:vortex-compact 18343378 18258361 1.00
tpch_q12/duckdb:vortex-compact 28976172 29697612 0.98
tpch_q13/duckdb:vortex-compact 44057169 44340959 0.99
tpch_q14/duckdb:vortex-compact 25815388 27103499 0.95
tpch_q15/duckdb:vortex-compact 19877085 19968392 1.00
tpch_q16/duckdb:vortex-compact 32508361 33099968 0.98
tpch_q17/duckdb:vortex-compact 28894383 29646804 0.97
tpch_q18/duckdb:vortex-compact 54261036 53658076 1.01
tpch_q19/duckdb:vortex-compact 33572480 33058951 1.02
tpch_q20/duckdb:vortex-compact 40008708 41224082 0.97
tpch_q21/duckdb:vortex-compact 101710191 102129226 1.00
tpch_q22/duckdb:vortex-compact 17971267 17999251 1.00
duckdb / parquet (0.996x ➖, 0↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 79048115 77115961 1.03
tpch_q02/duckdb:parquet 39115453 39307908 1.00
tpch_q03/duckdb:parquet 70109353 70843245 0.99
tpch_q04/duckdb:parquet 49055533 51287837 0.96
tpch_q05/duckdb:parquet 67935769 68074581 1.00
tpch_q06/duckdb:parquet 22172692 22361436 0.99
tpch_q07/duckdb:parquet 68455035 73106816 0.94
tpch_q08/duckdb:parquet 82262100 85698667 0.96
tpch_q09/duckdb:parquet 142780295 145659160 0.98
tpch_q10/duckdb:parquet 130046953 125213454 1.04
tpch_q11/duckdb:parquet 22105251 22359954 0.99
tpch_q12/duckdb:parquet 46876291 47155843 0.99
tpch_q13/duckdb:parquet 252717765 247210075 1.02
tpch_q14/duckdb:parquet 50131987 51507317 0.97
tpch_q15/duckdb:parquet 25964950 26091109 1.00
tpch_q16/duckdb:parquet 57866900 57995527 1.00
tpch_q17/duckdb:parquet 56929888 55891295 1.02
tpch_q18/duckdb:parquet 119215869 119524304 1.00
tpch_q19/duckdb:parquet 71189760 69675926 1.02
tpch_q20/duckdb:parquet 65107249 65451079 0.99
tpch_q21/duckdb:parquet 179224116 172589886 1.04
tpch_q22/duckdb:parquet 53674723 53312360 1.01
duckdb / duckdb (0.990x ➖, 1↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17543308 17865448 0.98
tpch_q02/duckdb:duckdb 14356269 14230571 1.01
tpch_q03/duckdb:duckdb 22101537 22448785 0.98
tpch_q04/duckdb:duckdb 21903858 22594942 0.97
tpch_q05/duckdb:duckdb 23411782 23203063 1.01
tpch_q06/duckdb:duckdb 6938458 7065362 0.98
tpch_q07/duckdb:duckdb 24988367 25443310 0.98
tpch_q08/duckdb:duckdb 24134968 23833294 1.01
tpch_q09/duckdb:duckdb 56396258 56945791 0.99
tpch_q10/duckdb:duckdb 49817701 52180636 0.95
tpch_q11/duckdb:duckdb 7064667 7180303 0.98
tpch_q12/duckdb:duckdb 18374015 18246832 1.01
tpch_q13/duckdb:duckdb 🚀 39235686 43905472 0.89
tpch_q14/duckdb:duckdb 21425163 21504098 1.00
tpch_q15/duckdb:duckdb 13806310 13927614 0.99
tpch_q16/duckdb:duckdb 26150626 26043019 1.00
tpch_q17/duckdb:duckdb 16342020 16382582 1.00
tpch_q18/duckdb:duckdb 40933475 40495080 1.01
tpch_q19/duckdb:duckdb 31542733 31491329 1.00
tpch_q20/duckdb:duckdb 25307251 25303699 1.00
tpch_q21/duckdb:duckdb 62803801 61694091 1.02
tpch_q22/duckdb:duckdb 25684004 25321073 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +6.3% -12.3% +21.2% +18.9% 🚨 regression
1 datafusion:vortex-compact +2.0% -12.3% +16.3% +18.1% ➖ noise
1 datafusion:vortex-file-compressed +0.7% -12.3% +14.8% +18.0% ➖ noise
1 duckdb:duckdb -1.8% -12.3% +12.0% +16.4% ➖ noise
1 duckdb:vortex-compact -0.3% -12.3% +13.7% +16.2% ➖ noise
1 duckdb:vortex-file-compressed +2.1% -12.3% +16.4% +19.8% ➖ noise
2 datafusion:arrow -4.6% -0.7% -4.0% +10.5% ➖ noise
2 datafusion:vortex-compact -1.7% -0.7% -1.0% +10.5% ➖ noise
2 datafusion:vortex-file-compressed -2.6% -0.7% -2.0% +10.5% ➖ noise
2 duckdb:duckdb +0.9% -0.7% +1.6% +10.5% ➖ noise
2 duckdb:vortex-compact -2.3% -0.7% -1.6% +10.5% ➖ noise
2 duckdb:vortex-file-compressed +1.7% -0.7% +2.4% +10.5% ➖ noise
3 datafusion:arrow +0.9% -2.1% +3.1% +10.5% ➖ noise
3 datafusion:vortex-compact -0.6% -2.1% +1.6% +10.5% ➖ noise
3 datafusion:vortex-file-compressed +2.7% -2.1% +4.9% +10.5% ➖ noise
3 duckdb:duckdb -1.5% -2.1% +0.6% +10.5% ➖ noise
3 duckdb:vortex-compact +0.5% -2.1% +2.7% +10.5% ➖ noise
3 duckdb:vortex-file-compressed +0.9% -2.1% +3.1% +11.7% ➖ noise
4 datafusion:arrow +0.6% -3.3% +4.0% +10.5% ➖ noise
4 datafusion:vortex-compact -5.2% -3.3% -2.0% +10.5% ➖ noise
4 datafusion:vortex-file-compressed +1.4% -3.3% +4.8% +10.5% ➖ noise
4 duckdb:duckdb -3.1% -3.3% +0.2% +10.5% ➖ noise
4 duckdb:vortex-compact -0.8% -3.3% +2.5% +10.6% ➖ noise
4 duckdb:vortex-file-compressed -1.5% -3.3% +1.9% +10.5% ➖ noise
5 datafusion:arrow +13.7% -0.9% +14.7% +10.5% 🚨 regression
5 datafusion:vortex-compact -3.8% -0.9% -3.0% +10.5% ➖ noise
5 datafusion:vortex-file-compressed -1.7% -0.9% -0.9% +10.5% ➖ noise
5 duckdb:duckdb +0.9% -0.9% +1.8% +10.5% ➖ noise
5 duckdb:vortex-compact -1.4% -0.9% -0.5% +10.5% ➖ noise
5 duckdb:vortex-file-compressed +0.7% -0.9% +1.6% +12.4% ➖ noise
6 datafusion:arrow +3.2% -8.2% +12.5% +15.2% ➖ noise
6 datafusion:vortex-compact -3.4% -8.2% +5.2% +13.8% ➖ noise
6 datafusion:vortex-file-compressed -7.9% -8.2% +0.3% +16.9% ➖ noise
6 duckdb:duckdb -1.8% -8.2% +7.0% +13.7% ➖ noise
6 duckdb:vortex-compact -7.8% -8.2% +0.5% +18.2% ➖ noise
6 duckdb:vortex-file-compressed +4.9% -8.2% +14.3% +15.9% ➖ noise
7 datafusion:arrow -1.0% -4.2% +3.3% +10.5% ➖ noise
7 datafusion:vortex-compact -0.2% -4.2% +4.2% +10.5% ➖ noise
7 datafusion:vortex-file-compressed -2.7% -4.2% +1.5% +10.5% ➖ noise
7 duckdb:duckdb -1.8% -4.2% +2.5% +10.5% ➖ noise
7 duckdb:vortex-compact -2.1% -4.2% +2.2% +10.5% ➖ noise
7 duckdb:vortex-file-compressed -2.9% -4.2% +1.3% +10.5% ➖ noise
8 datafusion:arrow -4.5% -3.2% -1.4% +10.5% ➖ noise
8 datafusion:vortex-compact -2.7% -3.2% +0.4% +10.5% ➖ noise
8 datafusion:vortex-file-compressed +0.6% -3.2% +3.9% +10.5% ➖ noise
8 duckdb:duckdb +1.3% -3.2% +4.6% +10.5% ➖ noise
8 duckdb:vortex-compact +0.8% -3.2% +4.1% +10.5% ➖ noise
8 duckdb:vortex-file-compressed -2.4% -3.2% +0.7% +12.7% ➖ noise
9 datafusion:arrow -6.8% -1.2% -5.7% +11.2% ➖ noise
9 datafusion:vortex-compact +0.1% -1.2% +1.3% +10.5% ➖ noise
9 datafusion:vortex-file-compressed -2.5% -1.2% -1.4% +10.5% ➖ noise
9 duckdb:duckdb -1.0% -1.2% +0.2% +10.5% ➖ noise
9 duckdb:vortex-compact +2.7% -1.2% +3.9% +10.5% ➖ noise
9 duckdb:vortex-file-compressed -0.1% -1.2% +1.0% +10.5% ➖ noise
10 datafusion:arrow -9.3% +1.1% -10.2% +10.5% ✅ faster
10 datafusion:vortex-compact -2.8% +1.1% -3.8% +10.5% ➖ noise
10 datafusion:vortex-file-compressed +1.1% +1.1% +0.1% +10.5% ➖ noise
10 duckdb:duckdb -4.5% +1.1% -5.5% +10.5% ➖ noise
10 duckdb:vortex-compact -1.9% +1.1% -2.9% +10.5% ➖ noise
10 duckdb:vortex-file-compressed -1.5% +1.1% -2.5% +10.5% ➖ noise
11 datafusion:arrow -2.8% -0.0% -2.7% +10.5% ➖ noise
11 datafusion:vortex-compact -8.2% -0.0% -8.2% +10.5% ➖ noise
11 datafusion:vortex-file-compressed -5.7% -0.0% -5.7% +10.5% ➖ noise
11 duckdb:duckdb -1.6% -0.0% -1.6% +10.5% ➖ noise
11 duckdb:vortex-compact +0.5% -0.0% +0.5% +14.6% ➖ noise
11 duckdb:vortex-file-compressed +1.5% -0.0% +1.5% +10.5% ➖ noise
12 datafusion:arrow -2.8% -5.1% +2.4% +19.5% ➖ noise
12 datafusion:vortex-compact -4.0% -5.1% +1.1% +11.2% ➖ noise
12 datafusion:vortex-file-compressed +0.0% -5.1% +5.4% +12.5% ➖ noise
12 duckdb:duckdb +0.7% -5.1% +6.1% +11.6% ➖ noise
12 duckdb:vortex-compact -2.4% -5.1% +2.8% +10.9% ➖ noise
12 duckdb:vortex-file-compressed -1.2% -5.1% +4.1% +12.7% ➖ noise
13 datafusion:arrow -1.6% +0.1% -1.7% +10.5% ➖ noise
13 datafusion:vortex-compact -2.0% +0.1% -2.1% +10.5% ➖ noise
13 datafusion:vortex-file-compressed -2.7% +0.1% -2.8% +10.5% ➖ noise
13 duckdb:duckdb -10.6% +0.1% -10.7% +12.7% ➖ noise
13 duckdb:vortex-compact -0.6% +0.1% -0.7% +10.5% ➖ noise
13 duckdb:vortex-file-compressed -0.3% +0.1% -0.4% +10.5% ➖ noise
14 datafusion:arrow -3.0% -3.4% +0.4% +12.7% ➖ noise
14 datafusion:vortex-compact -1.3% -3.4% +2.2% +10.5% ➖ noise
14 datafusion:vortex-file-compressed +1.0% -3.4% +4.5% +10.5% ➖ noise
14 duckdb:duckdb -0.4% -3.4% +3.2% +10.5% ➖ noise
14 duckdb:vortex-compact -4.8% -3.4% -1.4% +10.5% ➖ noise
14 duckdb:vortex-file-compressed +1.9% -3.4% +5.5% +11.5% ➖ noise
15 datafusion:arrow -2.2% +1.6% -3.8% +12.0% ➖ noise
15 datafusion:vortex-compact -2.9% +1.6% -4.4% +12.3% ➖ noise
15 datafusion:vortex-file-compressed -1.1% +1.6% -2.7% +12.2% ➖ noise
15 duckdb:duckdb -0.9% +1.6% -2.4% +12.7% ➖ noise
15 duckdb:vortex-compact -0.5% +1.6% -2.0% +11.5% ➖ noise
15 duckdb:vortex-file-compressed -2.1% +1.6% -3.6% +12.1% ➖ noise
16 datafusion:arrow -1.3% -0.6% -0.7% +10.5% ➖ noise
16 datafusion:vortex-compact -1.0% -0.6% -0.4% +10.5% ➖ noise
16 datafusion:vortex-file-compressed -0.8% -0.6% -0.2% +10.5% ➖ noise
16 duckdb:duckdb +0.4% -0.6% +1.1% +10.5% ➖ noise
16 duckdb:vortex-compact -1.8% -0.6% -1.2% +10.5% ➖ noise
16 duckdb:vortex-file-compressed -3.7% -0.6% -3.1% +10.5% ➖ noise
17 datafusion:arrow -3.0% -5.0% +2.1% +11.1% ➖ noise
17 datafusion:vortex-compact -3.9% -5.0% +1.2% +10.9% ➖ noise
17 datafusion:vortex-file-compressed -4.8% -5.0% +0.2% +11.9% ➖ noise
17 duckdb:duckdb -0.2% -5.0% +5.0% +10.5% ➖ noise
17 duckdb:vortex-compact -2.5% -5.0% +2.6% +12.6% ➖ noise
17 duckdb:vortex-file-compressed +3.0% -5.0% +8.4% +16.2% ➖ noise
18 datafusion:arrow +1.0% +0.4% +0.6% +10.5% ➖ noise
18 datafusion:vortex-compact -1.4% +0.4% -1.8% +10.5% ➖ noise
18 datafusion:vortex-file-compressed -3.6% +0.4% -4.0% +10.5% ➖ noise
18 duckdb:duckdb +1.1% +0.4% +0.6% +10.5% ➖ noise
18 duckdb:vortex-compact +1.1% +0.4% +0.7% +10.5% ➖ noise
18 duckdb:vortex-file-compressed -0.2% +0.4% -0.6% +10.5% ➖ noise
19 datafusion:arrow -1.4% +6.9% -7.8% +15.8% ➖ noise
19 datafusion:vortex-compact -1.5% +6.9% -7.8% +11.5% ➖ noise
19 datafusion:vortex-file-compressed -1.2% +6.9% -7.6% +11.4% ➖ noise
19 duckdb:duckdb +0.2% +6.9% -6.3% +11.0% ➖ noise
19 duckdb:vortex-compact +1.6% +6.9% -5.0% +10.9% ➖ noise
19 duckdb:vortex-file-compressed -4.9% +6.9% -11.0% +12.0% ✅ faster
20 datafusion:arrow -1.0% -0.7% -0.2% +10.5% ➖ noise
20 datafusion:vortex-compact -4.9% -0.7% -4.2% +10.5% ➖ noise
20 datafusion:vortex-file-compressed +2.6% -0.7% +3.3% +10.5% ➖ noise
20 duckdb:duckdb +0.0% -0.7% +0.8% +10.5% ➖ noise
20 duckdb:vortex-compact -2.9% -0.7% -2.2% +10.5% ➖ noise
20 duckdb:vortex-file-compressed -0.7% -0.7% -0.0% +10.5% ➖ noise
21 datafusion:arrow +4.0% -1.0% +5.0% +10.5% ➖ noise
21 datafusion:vortex-compact -0.8% -1.0% +0.2% +10.5% ➖ noise
21 datafusion:vortex-file-compressed -1.4% -1.0% -0.4% +10.5% ➖ noise
21 duckdb:duckdb +1.8% -1.0% +2.8% +10.5% ➖ noise
21 duckdb:vortex-compact -0.4% -1.0% +0.6% +10.5% ➖ noise
21 duckdb:vortex-file-compressed -1.5% -1.0% -0.5% +10.5% ➖ noise
22 datafusion:arrow -3.3% -2.0% -1.4% +10.5% ➖ noise
22 datafusion:vortex-compact -1.9% -2.0% +0.1% +10.5% ➖ noise
22 datafusion:vortex-file-compressed +1.7% -2.0% +3.7% +10.5% ➖ noise
22 duckdb:duckdb +1.4% -2.0% +3.5% +10.5% ➖ noise
22 duckdb:vortex-compact -0.2% -2.0% +1.9% +10.5% ➖ noise
22 duckdb:vortex-file-compressed -2.2% -2.0% -0.2% +10.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

File Size Changes (18 files changed, -0.0% overall, 0↑ 18↓)
File Scale Format Base HEAD Change %
lineitem_0.vortex 1.0 vortex-file-compressed 85.42 MB 85.42 MB 32 B -0.0%
lineitem_1.vortex 1.0 vortex-file-compressed 84.90 MB 84.90 MB 32 B -0.0%
lineitem_1.vortex 1.0 vortex-compact 63.03 MB 63.03 MB 32 B -0.0%
lineitem_0.vortex 1.0 vortex-compact 63.00 MB 63.00 MB 32 B -0.0%
orders_0.vortex 1.0 vortex-file-compressed 43.43 MB 43.43 MB 32 B -0.0%
partsupp_0.vortex 1.0 vortex-file-compressed 35.94 MB 35.94 MB 32 B -0.0%
orders_0.vortex 1.0 vortex-compact 31.73 MB 31.73 MB 32 B -0.0%
partsupp_0.vortex 1.0 vortex-compact 25.23 MB 25.23 MB 32 B -0.0%
customer_0.vortex 1.0 vortex-file-compressed 10.50 MB 10.50 MB 32 B -0.0%
customer_0.vortex 1.0 vortex-compact 7.43 MB 7.43 MB 32 B -0.0%
part_0.vortex 1.0 vortex-file-compressed 5.44 MB 5.44 MB 32 B -0.0%
part_0.vortex 1.0 vortex-compact 3.64 MB 3.64 MB 32 B -0.0%
supplier_0.vortex 1.0 vortex-file-compressed 706.34 KB 706.31 KB 32 B -0.0%
supplier_0.vortex 1.0 vortex-compact 496.72 KB 496.69 KB 32 B -0.0%
nation_0.vortex 1.0 vortex-file-compressed 11.00 KB 10.97 KB 32 B -0.3%
nation_0.vortex 1.0 vortex-compact 8.34 KB 8.31 KB 32 B -0.4%
region_0.vortex 1.0 vortex-file-compressed 6.16 KB 6.13 KB 32 B -0.5%
region_0.vortex 1.0 vortex-compact 5.86 KB 5.82 KB 32 B -0.5%

Totals:

  • vortex-compact: 194.82 MB → 194.82 MB (-0.0%)
  • vortex-file-compressed: 266.61 MB → 266.60 MB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Vortex (geomean): 1.000x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.5%


datafusion / vortex-file-compressed (0.998x ➖, 1↑ 1↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 24763552 26746045 0.93
tpcds_q02/datafusion:vortex-file-compressed 46308991 46707042 0.99
tpcds_q03/datafusion:vortex-file-compressed 15057138 14814487 1.02
tpcds_q04/datafusion:vortex-file-compressed 247825282 243985802 1.02
tpcds_q05/datafusion:vortex-file-compressed 41467827 42585845 0.97
tpcds_q06/datafusion:vortex-file-compressed 60898075 58705341 1.04
tpcds_q07/datafusion:vortex-file-compressed 43219996 41038988 1.05
tpcds_q08/datafusion:vortex-file-compressed 29324693 28007042 1.05
tpcds_q09/datafusion:vortex-file-compressed 38976126 38066799 1.02
tpcds_q10/datafusion:vortex-file-compressed 37990027 38396219 0.99
tpcds_q11/datafusion:vortex-file-compressed 123142512 126434652 0.97
tpcds_q12/datafusion:vortex-file-compressed 19766615 18678675 1.06
tpcds_q13/datafusion:vortex-file-compressed 38783323 39511214 0.98
tpcds_q14/datafusion:vortex-file-compressed 167734463 167867412 1.00
tpcds_q15/datafusion:vortex-file-compressed 28341134 28445502 1.00
tpcds_q16/datafusion:vortex-file-compressed 27734309 27905909 0.99
tpcds_q17/datafusion:vortex-file-compressed 62374191 61832393 1.01
tpcds_q18/datafusion:vortex-file-compressed 68087444 68913428 0.99
tpcds_q19/datafusion:vortex-file-compressed 21314869 22314539 0.96
tpcds_q20/datafusion:vortex-file-compressed 21107537 21781483 0.97
tpcds_q21/datafusion:vortex-file-compressed 34523522 33738310 1.02
tpcds_q22/datafusion:vortex-file-compressed 🚨 149021414 114263614 1.30
tpcds_q23/datafusion:vortex-file-compressed 150709539 152513253 0.99
tpcds_q24/datafusion:vortex-file-compressed 81633871 82953509 0.98
tpcds_q25/datafusion:vortex-file-compressed 65733744 63496227 1.04
tpcds_q26/datafusion:vortex-file-compressed 33305784 32728021 1.02
tpcds_q27/datafusion:vortex-file-compressed 99329768 101847448 0.98
tpcds_q28/datafusion:vortex-file-compressed 33339860 34409466 0.97
tpcds_q29/datafusion:vortex-file-compressed 61400056 60309683 1.02
tpcds_q30/datafusion:vortex-file-compressed 22455915 22976710 0.98
tpcds_q31/datafusion:vortex-file-compressed 72042092 74014451 0.97
tpcds_q32/datafusion:vortex-file-compressed 20283586 19369114 1.05
tpcds_q33/datafusion:vortex-file-compressed 30859866 29108978 1.06
tpcds_q34/datafusion:vortex-file-compressed 23866578 23881843 1.00
tpcds_q35/datafusion:vortex-file-compressed 43408753 44233063 0.98
tpcds_q36/datafusion:vortex-file-compressed 55611146 58025574 0.96
tpcds_q37/datafusion:vortex-file-compressed 23293826 23738600 0.98
tpcds_q38/datafusion:vortex-file-compressed 41700411 42603296 0.98
tpcds_q39/datafusion:vortex-file-compressed 104598261 103236475 1.01
tpcds_q40/datafusion:vortex-file-compressed 31951521 31931694 1.00
tpcds_q41/datafusion:vortex-file-compressed 14869303 14881486 1.00
tpcds_q42/datafusion:vortex-file-compressed 13494982 13554962 1.00
tpcds_q43/datafusion:vortex-file-compressed 18448465 18792838 0.98
tpcds_q44/datafusion:vortex-file-compressed 31337968 31879793 0.98
tpcds_q45/datafusion:vortex-file-compressed 26498475 27369836 0.97
tpcds_q46/datafusion:vortex-file-compressed 33719088 35242226 0.96
tpcds_q47/datafusion:vortex-file-compressed 128254429 131194346 0.98
tpcds_q48/datafusion:vortex-file-compressed 35026526 34731349 1.01
tpcds_q49/datafusion:vortex-file-compressed 57077067 56813250 1.00
tpcds_q50/datafusion:vortex-file-compressed 38541869 39548090 0.97
tpcds_q51/datafusion:vortex-file-compressed 85165913 85354296 1.00
tpcds_q52/datafusion:vortex-file-compressed 14328968 14695118 0.98
tpcds_q53/datafusion:vortex-file-compressed 21646079 20781997 1.04
tpcds_q54/datafusion:vortex-file-compressed 34905423 34960589 1.00
tpcds_q55/datafusion:vortex-file-compressed 13937496 14332916 0.97
tpcds_q56/datafusion:vortex-file-compressed 29416751 29479092 1.00
tpcds_q57/datafusion:vortex-file-compressed 106040260 103655653 1.02
tpcds_q58/datafusion:vortex-file-compressed 51273636 53808094 0.95
tpcds_q59/datafusion:vortex-file-compressed 55277709 56180677 0.98
tpcds_q60/datafusion:vortex-file-compressed 28757490 29845712 0.96
tpcds_q61/datafusion:vortex-file-compressed 40641146 39973772 1.02
tpcds_q62/datafusion:vortex-file-compressed 21480878 23370912 0.92
tpcds_q63/datafusion:vortex-file-compressed 20894037 21155230 0.99
tpcds_q64/datafusion:vortex-file-compressed 406335330 411212981 0.99
tpcds_q65/datafusion:vortex-file-compressed 38299201 38131274 1.00
tpcds_q66/datafusion:vortex-file-compressed 72495387 70748947 1.02
tpcds_q67/datafusion:vortex-file-compressed 140522620 147719096 0.95
tpcds_q68/datafusion:vortex-file-compressed 31860897 31386395 1.02
tpcds_q69/datafusion:vortex-file-compressed 35429742 35406463 1.00
tpcds_q70/datafusion:vortex-file-compressed 84954487 86192853 0.99
tpcds_q71/datafusion:vortex-file-compressed 23009755 22701896 1.01
tpcds_q72/datafusion:vortex-file-compressed 2152302428 2140300584 1.01
tpcds_q73/datafusion:vortex-file-compressed 22407109 22324186 1.00
tpcds_q74/datafusion:vortex-file-compressed 79605506 77719395 1.02
tpcds_q75/datafusion:vortex-file-compressed 107380756 106525227 1.01
tpcds_q76/datafusion:vortex-file-compressed 23884481 24626327 0.97
tpcds_q77/datafusion:vortex-file-compressed 39178339 38423085 1.02
tpcds_q78/datafusion:vortex-file-compressed 123732257 124243048 1.00
tpcds_q79/datafusion:vortex-file-compressed 27785807 27716771 1.00
tpcds_q80/datafusion:vortex-file-compressed 91308841 92692306 0.99
tpcds_q81/datafusion:vortex-file-compressed 23734922 23388927 1.01
tpcds_q82/datafusion:vortex-file-compressed 24246088 24338300 1.00
tpcds_q83/datafusion:vortex-file-compressed 33038094 32960813 1.00
tpcds_q84/datafusion:vortex-file-compressed 12346871 12828700 0.96
tpcds_q85/datafusion:vortex-file-compressed 91629885 88133153 1.04
tpcds_q86/datafusion:vortex-file-compressed 15137804 16144219 0.94
tpcds_q87/datafusion:vortex-file-compressed 42097410 42072019 1.00
tpcds_q88/datafusion:vortex-file-compressed 55170795 54888868 1.01
tpcds_q89/datafusion:vortex-file-compressed 24320515 24429627 1.00
tpcds_q90/datafusion:vortex-file-compressed 14648147 13795412 1.06
tpcds_q91/datafusion:vortex-file-compressed 17607817 17458834 1.01
tpcds_q92/datafusion:vortex-file-compressed 18072856 17810078 1.01
tpcds_q93/datafusion:vortex-file-compressed 32886319 32383195 1.02
tpcds_q94/datafusion:vortex-file-compressed 22284614 23266155 0.96
tpcds_q95/datafusion:vortex-file-compressed 61630485 60860201 1.01
tpcds_q96/datafusion:vortex-file-compressed 13435026 13451258 1.00
tpcds_q97/datafusion:vortex-file-compressed 31009778 30096633 1.03
tpcds_q98/datafusion:vortex-file-compressed 24178218 23722362 1.02
tpcds_q99/datafusion:vortex-file-compressed 🚀 27812147 31743282 0.88
datafusion / vortex-compact (0.994x ➖, 1↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 24849604 25070816 0.99
tpcds_q02/datafusion:vortex-compact 53250967 53491231 1.00
tpcds_q03/datafusion:vortex-compact 19572680 19502383 1.00
tpcds_q04/datafusion:vortex-compact 290504723 286954931 1.01
tpcds_q05/datafusion:vortex-compact 48098489 46762182 1.03
tpcds_q06/datafusion:vortex-compact 61378723 65147887 0.94
tpcds_q07/datafusion:vortex-compact 52036223 52158426 1.00
tpcds_q08/datafusion:vortex-compact 35490309 35404041 1.00
tpcds_q09/datafusion:vortex-compact 53008281 51787371 1.02
tpcds_q10/datafusion:vortex-compact 48808740 51132343 0.95
tpcds_q11/datafusion:vortex-compact 151429885 151494692 1.00
tpcds_q12/datafusion:vortex-compact 24303228 24636860 0.99
tpcds_q13/datafusion:vortex-compact 122112624 122102005 1.00
tpcds_q14/datafusion:vortex-compact 198009186 196598293 1.01
tpcds_q15/datafusion:vortex-compact 29770059 30033252 0.99
tpcds_q16/datafusion:vortex-compact 31990241 33207277 0.96
tpcds_q17/datafusion:vortex-compact 71531188 73927610 0.97
tpcds_q18/datafusion:vortex-compact 78486833 76321383 1.03
tpcds_q19/datafusion:vortex-compact 29783179 29076995 1.02
tpcds_q20/datafusion:vortex-compact 26413597 25954383 1.02
tpcds_q21/datafusion:vortex-compact 39418871 39161558 1.01
tpcds_q22/datafusion:vortex-compact 120878952 115243550 1.05
tpcds_q23/datafusion:vortex-compact 163453617 164808092 0.99
tpcds_q24/datafusion:vortex-compact 94356336 98682084 0.96
tpcds_q25/datafusion:vortex-compact 76557184 79743380 0.96
tpcds_q26/datafusion:vortex-compact 42008403 41860331 1.00
tpcds_q27/datafusion:vortex-compact 124693215 131062300 0.95
tpcds_q28/datafusion:vortex-compact 95060348 96128256 0.99
tpcds_q29/datafusion:vortex-compact 72636882 77621833 0.94
tpcds_q30/datafusion:vortex-compact 26329513 27034184 0.97
tpcds_q31/datafusion:vortex-compact 97188457 96831030 1.00
tpcds_q32/datafusion:vortex-compact 24631672 25651190 0.96
tpcds_q33/datafusion:vortex-compact 35184117 36905502 0.95
tpcds_q34/datafusion:vortex-compact 32684765 32610306 1.00
tpcds_q35/datafusion:vortex-compact 50848613 51694378 0.98
tpcds_q36/datafusion:vortex-compact 71840178 74789531 0.96
tpcds_q37/datafusion:vortex-compact 32946390 33549095 0.98
tpcds_q38/datafusion:vortex-compact 49051176 49966372 0.98
tpcds_q39/datafusion:vortex-compact 113809627 113821145 1.00
tpcds_q40/datafusion:vortex-compact 35370689 36249901 0.98
tpcds_q41/datafusion:vortex-compact 17019238 16852778 1.01
tpcds_q42/datafusion:vortex-compact 17547561 17859158 0.98
tpcds_q43/datafusion:vortex-compact 25328956 24761090 1.02
tpcds_q44/datafusion:vortex-compact 47039718 48017265 0.98
tpcds_q45/datafusion:vortex-compact 32054914 33808849 0.95
tpcds_q46/datafusion:vortex-compact 43840861 44224269 0.99
tpcds_q47/datafusion:vortex-compact 148730816 148581225 1.00
tpcds_q48/datafusion:vortex-compact 81619972 79034032 1.03
tpcds_q49/datafusion:vortex-compact 70069220 68534458 1.02
tpcds_q50/datafusion:vortex-compact 46993000 47824642 0.98
tpcds_q51/datafusion:vortex-compact 93076469 94305282 0.99
tpcds_q52/datafusion:vortex-compact 19195732 18672607 1.03
tpcds_q53/datafusion:vortex-compact 28151146 27709466 1.02
tpcds_q54/datafusion:vortex-compact 42647816 42351733 1.01
tpcds_q55/datafusion:vortex-compact 17662553 17541728 1.01
tpcds_q56/datafusion:vortex-compact 37371555 35544071 1.05
tpcds_q57/datafusion:vortex-compact 114149004 114669876 1.00
tpcds_q58/datafusion:vortex-compact 61196254 62930886 0.97
tpcds_q59/datafusion:vortex-compact 67713892 67518788 1.00
tpcds_q60/datafusion:vortex-compact 34682014 35234528 0.98
tpcds_q61/datafusion:vortex-compact 54329210 56609498 0.96
tpcds_q62/datafusion:vortex-compact 🚀 27206312 31366862 0.87
tpcds_q63/datafusion:vortex-compact 27994868 27116991 1.03
tpcds_q64/datafusion:vortex-compact 447844798 455800643 0.98
tpcds_q65/datafusion:vortex-compact 56665286 52198804 1.09
tpcds_q66/datafusion:vortex-compact 77753351 77316598 1.01
tpcds_q67/datafusion:vortex-compact 151824277 154804485 0.98
tpcds_q68/datafusion:vortex-compact 43575003 44477063 0.98
tpcds_q69/datafusion:vortex-compact 44971621 45454006 0.99
tpcds_q70/datafusion:vortex-compact 101052864 98167151 1.03
tpcds_q71/datafusion:vortex-compact 30218201 29648768 1.02
tpcds_q72/datafusion:vortex-compact 2123874115 2120103702 1.00
tpcds_q73/datafusion:vortex-compact 30223787 30195258 1.00
tpcds_q74/datafusion:vortex-compact 89917607 92493662 0.97
tpcds_q75/datafusion:vortex-compact 126329557 126679302 1.00
tpcds_q76/datafusion:vortex-compact 32175053 32313822 1.00
tpcds_q77/datafusion:vortex-compact 49146981 49810644 0.99
tpcds_q78/datafusion:vortex-compact 136775994 139257970 0.98
tpcds_q79/datafusion:vortex-compact 37734902 38171538 0.99
tpcds_q80/datafusion:vortex-compact 103683816 104179534 1.00
tpcds_q81/datafusion:vortex-compact 28027410 29462393 0.95
tpcds_q82/datafusion:vortex-compact 34897779 33922200 1.03
tpcds_q83/datafusion:vortex-compact 32467641 32932307 0.99
tpcds_q84/datafusion:vortex-compact 13994920 13849818 1.01
tpcds_q85/datafusion:vortex-compact 161793168 151448182 1.07
tpcds_q86/datafusion:vortex-compact 19638437 18278141 1.07
tpcds_q87/datafusion:vortex-compact 49254271 50410403 0.98
tpcds_q88/datafusion:vortex-compact 76710803 77638097 0.99
tpcds_q89/datafusion:vortex-compact 33262386 30549690 1.09
tpcds_q90/datafusion:vortex-compact 14619639 15348957 0.95
tpcds_q91/datafusion:vortex-compact 31439669 31999094 0.98
tpcds_q92/datafusion:vortex-compact 22343741 22891027 0.98
tpcds_q93/datafusion:vortex-compact 37764552 37948585 1.00
tpcds_q94/datafusion:vortex-compact 24801400 24728246 1.00
tpcds_q95/datafusion:vortex-compact 63062657 67166118 0.94
tpcds_q96/datafusion:vortex-compact 16992145 17185741 0.99
tpcds_q97/datafusion:vortex-compact 35525519 35268940 1.01
tpcds_q98/datafusion:vortex-compact 29747206 29159587 1.02
tpcds_q99/datafusion:vortex-compact 29885009 30852257 0.97
datafusion / parquet (0.997x ➖, 1↑ 1↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 29040300 29725723 0.98
tpcds_q02/datafusion:parquet 42401376 41264769 1.03
tpcds_q03/datafusion:parquet 13044495 13359114 0.98
tpcds_q04/datafusion:parquet 256455373 270795245 0.95
tpcds_q05/datafusion:parquet 39668099 40124996 0.99
tpcds_q06/datafusion:parquet 57863318 58857271 0.98
tpcds_q07/datafusion:parquet 78721236 74774251 1.05
tpcds_q08/datafusion:parquet 26266475 25272615 1.04
tpcds_q09/datafusion:parquet 45365759 45524239 1.00
tpcds_q10/datafusion:parquet 69222055 67813554 1.02
tpcds_q11/datafusion:parquet 142278330 145888400 0.98
tpcds_q12/datafusion:parquet 17002350 17339020 0.98
tpcds_q13/datafusion:parquet 72938994 73170239 1.00
tpcds_q14/datafusion:parquet 159609368 159894316 1.00
tpcds_q15/datafusion:parquet 20942744 21401529 0.98
tpcds_q16/datafusion:parquet 22967763 23773155 0.97
tpcds_q17/datafusion:parquet 63812327 68705518 0.93
tpcds_q18/datafusion:parquet 110125690 114877955 0.96
tpcds_q19/datafusion:parquet 21793401 22183657 0.98
tpcds_q20/datafusion:parquet 15796743 15682397 1.01
tpcds_q21/datafusion:parquet 19635431 18150759 1.08
tpcds_q22/datafusion:parquet 🚀 142290627 174953292 0.81
tpcds_q23/datafusion:parquet 146370587 139427905 1.05
tpcds_q24/datafusion:parquet 87961804 88898640 0.99
tpcds_q25/datafusion:parquet 63941526 63726595 1.00
tpcds_q26/datafusion:parquet 63749066 63653466 1.00
tpcds_q27/datafusion:parquet 141540865 144766770 0.98
tpcds_q28/datafusion:parquet 43890259 44281004 0.99
tpcds_q29/datafusion:parquet 62867878 65562464 0.96
tpcds_q30/datafusion:parquet 35064817 33170648 1.06
tpcds_q31/datafusion:parquet 62769468 63304342 0.99
tpcds_q32/datafusion:parquet 17857525 17751321 1.01
tpcds_q33/datafusion:parquet 25929329 26685324 0.97
tpcds_q34/datafusion:parquet 19749610 20751858 0.95
tpcds_q35/datafusion:parquet 67988727 67961308 1.00
tpcds_q36/datafusion:parquet 56036415 55419291 1.01
tpcds_q37/datafusion:parquet 18419354 18637052 0.99
tpcds_q38/datafusion:parquet 39971470 38742054 1.03
tpcds_q39/datafusion:parquet 72033395 71829626 1.00
tpcds_q40/datafusion:parquet 22961685 23121301 0.99
tpcds_q41/datafusion:parquet 12973482 13041026 0.99
tpcds_q42/datafusion:parquet 11765455 11115134 1.06
tpcds_q43/datafusion:parquet 16602288 16547437 1.00
tpcds_q44/datafusion:parquet 31674047 32126808 0.99
tpcds_q45/datafusion:parquet 27456309 27491291 1.00
tpcds_q46/datafusion:parquet 30555573 31286963 0.98
tpcds_q47/datafusion:parquet 122287959 122242344 1.00
tpcds_q48/datafusion:parquet 67657650 69728141 0.97
tpcds_q49/datafusion:parquet 54721686 56639721 0.97
tpcds_q50/datafusion:parquet 43555125 42663489 1.02
tpcds_q51/datafusion:parquet 82570710 82834363 1.00
tpcds_q52/datafusion:parquet 11344955 12082858 0.94
tpcds_q53/datafusion:parquet 17947663 17309667 1.04
tpcds_q54/datafusion:parquet 33751983 32770812 1.03
tpcds_q55/datafusion:parquet 10755898 11009692 0.98
tpcds_q56/datafusion:parquet 27234196 26945038 1.01
tpcds_q57/datafusion:parquet 98339476 103735845 0.95
tpcds_q58/datafusion:parquet 49072975 47481250 1.03
tpcds_q59/datafusion:parquet 55303577 56572980 0.98
tpcds_q60/datafusion:parquet 26014068 26419668 0.98
tpcds_q61/datafusion:parquet 42214907 41358231 1.02
tpcds_q62/datafusion:parquet 23725557 22486329 1.06
tpcds_q63/datafusion:parquet 17057199 17488363 0.98
tpcds_q64/datafusion:parquet 500645285 500412900 1.00
tpcds_q65/datafusion:parquet 36025767 36138121 1.00
tpcds_q66/datafusion:parquet 68454902 66727941 1.03
tpcds_q67/datafusion:parquet 146184652 144556545 1.01
tpcds_q68/datafusion:parquet 30902225 31622377 0.98
tpcds_q69/datafusion:parquet 62503368 62646111 1.00
tpcds_q70/datafusion:parquet 84294208 87441819 0.96
tpcds_q71/datafusion:parquet 21439188 22103926 0.97
tpcds_q72/datafusion:parquet 583960198 592033362 0.99
tpcds_q73/datafusion:parquet 20381663 20086836 1.01
tpcds_q74/datafusion:parquet 83993636 80976175 1.04
tpcds_q75/datafusion:parquet 97446090 95162118 1.02
tpcds_q76/datafusion:parquet 29887770 29960477 1.00
tpcds_q77/datafusion:parquet 38162916 37981404 1.00
tpcds_q78/datafusion:parquet 111398584 111586119 1.00
tpcds_q79/datafusion:parquet 26074167 25803490 1.01
tpcds_q80/datafusion:parquet 78765812 78539276 1.00
tpcds_q81/datafusion:parquet 31036522 31271213 0.99
tpcds_q82/datafusion:parquet 18955088 18734909 1.01
tpcds_q83/datafusion:parquet 35103614 36346611 0.97
tpcds_q84/datafusion:parquet 38677387 38071538 1.02
tpcds_q85/datafusion:parquet 144235708 145202498 0.99
tpcds_q86/datafusion:parquet 🚨 15855057 14341831 1.11
tpcds_q87/datafusion:parquet 38931288 39164278 0.99
tpcds_q88/datafusion:parquet 58574796 57626051 1.02
tpcds_q89/datafusion:parquet 21395688 20161899 1.06
tpcds_q90/datafusion:parquet 13541868 13902268 0.97
tpcds_q91/datafusion:parquet 56185021 57486564 0.98
tpcds_q92/datafusion:parquet 17835106 18262804 0.98
tpcds_q93/datafusion:parquet 30981897 30820878 1.01
tpcds_q94/datafusion:parquet 19811981 19293319 1.03
tpcds_q95/datafusion:parquet 59662212 57882485 1.03
tpcds_q96/datafusion:parquet 11796090 11314103 1.04
tpcds_q97/datafusion:parquet 28559369 29434467 0.97
tpcds_q98/datafusion:parquet 20168026 21345005 0.94
tpcds_q99/datafusion:parquet 24649270 24720691 1.00
duckdb / vortex-file-compressed (1.000x ➖, 1↑ 1↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 23717637 24087080 0.98
tpcds_q02/duckdb:vortex-file-compressed 34447245 34388209 1.00
tpcds_q03/duckdb:vortex-file-compressed 26394676 26381062 1.00
tpcds_q04/duckdb:vortex-file-compressed 94502838 93567463 1.01
tpcds_q05/duckdb:vortex-file-compressed 31069153 32028312 0.97
tpcds_q06/duckdb:vortex-file-compressed 33041024 33426950 0.99
tpcds_q07/duckdb:vortex-file-compressed 21569556 22157456 0.97
tpcds_q08/duckdb:vortex-file-compressed 26398243 26226370 1.01
tpcds_q09/duckdb:vortex-file-compressed 16989235 15816482 1.07
tpcds_q10/duckdb:vortex-file-compressed 36936869 37410705 0.99
tpcds_q11/duckdb:vortex-file-compressed 63453415 65248039 0.97
tpcds_q12/duckdb:vortex-file-compressed 15505219 15397950 1.01
tpcds_q13/duckdb:vortex-file-compressed 31772209 33507082 0.95
tpcds_q14/duckdb:vortex-file-compressed 98295550 99738277 0.99
tpcds_q15/duckdb:vortex-file-compressed 26267744 27823935 0.94
tpcds_q16/duckdb:vortex-file-compressed 26124223 25208958 1.04
tpcds_q17/duckdb:vortex-file-compressed 45495181 45808173 0.99
tpcds_q18/duckdb:vortex-file-compressed 36625701 37292397 0.98
tpcds_q19/duckdb:vortex-file-compressed 31162972 31617751 0.99
tpcds_q20/duckdb:vortex-file-compressed 16645385 16619668 1.00
tpcds_q21/duckdb:vortex-file-compressed 16175051 16507774 0.98
tpcds_q22/duckdb:vortex-file-compressed 74511145 73645761 1.01
tpcds_q23/duckdb:vortex-file-compressed 104926855 98287936 1.07
tpcds_q24/duckdb:vortex-file-compressed 48416676 47003951 1.03
tpcds_q25/duckdb:vortex-file-compressed 49727908 49723634 1.00
tpcds_q26/duckdb:vortex-file-compressed 18335557 18433598 0.99
tpcds_q27/duckdb:vortex-file-compressed 23365966 23123859 1.01
tpcds_q28/duckdb:vortex-file-compressed 12267706 12581670 0.98
tpcds_q29/duckdb:vortex-file-compressed 42628263 42224236 1.01
tpcds_q30/duckdb:vortex-file-compressed 24499123 25131289 0.97
tpcds_q31/duckdb:vortex-file-compressed 29678485 30723583 0.97
tpcds_q32/duckdb:vortex-file-compressed 12973340 13260247 0.98
tpcds_q33/duckdb:vortex-file-compressed 23598863 24129152 0.98
tpcds_q34/duckdb:vortex-file-compressed 24684427 24923261 0.99
tpcds_q35/duckdb:vortex-file-compressed 63783173 64703494 0.99
tpcds_q36/duckdb:vortex-file-compressed 24008318 23919382 1.00
tpcds_q37/duckdb:vortex-file-compressed 20145954 19533222 1.03
tpcds_q38/duckdb:vortex-file-compressed 35836187 36229494 0.99
tpcds_q39/duckdb:vortex-file-compressed 35310249 34953217 1.01
tpcds_q40/duckdb:vortex-file-compressed 19351914 20222289 0.96
tpcds_q41/duckdb:vortex-file-compressed 10054987 10378535 0.97
tpcds_q42/duckdb:vortex-file-compressed 12983313 13321154 0.97
tpcds_q43/duckdb:vortex-file-compressed 🚀 17449782 20471248 0.85
tpcds_q44/duckdb:vortex-file-compressed 20539635 21086740 0.97
tpcds_q45/duckdb:vortex-file-compressed 29572804 29783973 0.99
tpcds_q46/duckdb:vortex-file-compressed 32751679 31307319 1.05
tpcds_q47/duckdb:vortex-file-compressed 52669260 51317718 1.03
tpcds_q48/duckdb:vortex-file-compressed 29027910 28896143 1.00
tpcds_q49/duckdb:vortex-file-compressed 32181222 31373512 1.03
tpcds_q50/duckdb:vortex-file-compressed 31249495 29755845 1.05
tpcds_q51/duckdb:vortex-file-compressed 106758487 108099013 0.99
tpcds_q52/duckdb:vortex-file-compressed 13240413 12920272 1.02
tpcds_q53/duckdb:vortex-file-compressed 22761652 21719408 1.05
tpcds_q54/duckdb:vortex-file-compressed 27830927 27866729 1.00
tpcds_q55/duckdb:vortex-file-compressed 12235321 12482641 0.98
tpcds_q56/duckdb:vortex-file-compressed 24626261 24797758 0.99
tpcds_q57/duckdb:vortex-file-compressed 43713566 41377320 1.06
tpcds_q58/duckdb:vortex-file-compressed 29204227 29082792 1.00
tpcds_q59/duckdb:vortex-file-compressed 67390219 68152864 0.99
tpcds_q60/duckdb:vortex-file-compressed 26004060 26621265 0.98
tpcds_q61/duckdb:vortex-file-compressed 30010420 30348164 0.99
tpcds_q62/duckdb:vortex-file-compressed 14809371 15561481 0.95
tpcds_q63/duckdb:vortex-file-compressed 20326500 20028345 1.01
tpcds_q64/duckdb:vortex-file-compressed 102304619 102252583 1.00
tpcds_q65/duckdb:vortex-file-compressed 22311140 22531184 0.99
tpcds_q66/duckdb:vortex-file-compressed 27827603 28095276 0.99
tpcds_q67/duckdb:vortex-file-compressed 148687013 138860372 1.07
tpcds_q68/duckdb:vortex-file-compressed 31150904 30736787 1.01
tpcds_q69/duckdb:vortex-file-compressed 40825294 40468403 1.01
tpcds_q70/duckdb:vortex-file-compressed 38229209 37268834 1.03
tpcds_q71/duckdb:vortex-file-compressed 20232760 20496807 0.99
tpcds_q72/duckdb:vortex-file-compressed 170997258 170459606 1.00
tpcds_q73/duckdb:vortex-file-compressed 24323971 24209121 1.00
tpcds_q74/duckdb:vortex-file-compressed 42811741 41962927 1.02
tpcds_q75/duckdb:vortex-file-compressed 49338116 50404703 0.98
tpcds_q76/duckdb:vortex-file-compressed 🚨 20618061 17388134 1.19
tpcds_q77/duckdb:vortex-file-compressed 23141007 22474557 1.03
tpcds_q78/duckdb:vortex-file-compressed 77086483 80534316 0.96
tpcds_q79/duckdb:vortex-file-compressed 25473863 24774030 1.03
tpcds_q80/duckdb:vortex-file-compressed 49109740 45919665 1.07
tpcds_q81/duckdb:vortex-file-compressed 29103982 29342734 0.99
tpcds_q82/duckdb:vortex-file-compressed 46264572 45439913 1.02
tpcds_q83/duckdb:vortex-file-compressed 26943101 28700203 0.94
tpcds_q84/duckdb:vortex-file-compressed 19980325 20623313 0.97
tpcds_q85/duckdb:vortex-file-compressed 45382486 45359841 1.00
tpcds_q86/duckdb:vortex-file-compressed 17839513 16335662 1.09
tpcds_q87/duckdb:vortex-file-compressed 41256407 42047127 0.98
tpcds_q88/duckdb:vortex-file-compressed 51138382 50230378 1.02
tpcds_q89/duckdb:vortex-file-compressed 21708146 21634485 1.00
tpcds_q90/duckdb:vortex-file-compressed 10149042 10244962 0.99
tpcds_q91/duckdb:vortex-file-compressed 24813315 25699338 0.97
tpcds_q92/duckdb:vortex-file-compressed 18584961 17919826 1.04
tpcds_q93/duckdb:vortex-file-compressed 28985165 29120200 1.00
tpcds_q94/duckdb:vortex-file-compressed 20669511 20707508 1.00
tpcds_q95/duckdb:vortex-file-compressed 158117396 161584910 0.98
tpcds_q96/duckdb:vortex-file-compressed 12433066 12193956 1.02
tpcds_q97/duckdb:vortex-file-compressed 37656295 38185106 0.99
tpcds_q98/duckdb:vortex-file-compressed 18760878 19390359 0.97
tpcds_q99/duckdb:vortex-file-compressed 25238202 25075693 1.01
duckdb / vortex-compact (1.007x ➖, 1↑ 2↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 25852860 26480033 0.98
tpcds_q02/duckdb:vortex-compact 🚨 41948795 30308923 1.38
tpcds_q03/duckdb:vortex-compact 49895007 48490927 1.03
tpcds_q04/duckdb:vortex-compact 102698962 100881295 1.02
tpcds_q05/duckdb:vortex-compact 43825601 40912644 1.07
tpcds_q06/duckdb:vortex-compact 37393128 38285641 0.98
tpcds_q07/duckdb:vortex-compact 33478490 33555701 1.00
tpcds_q08/duckdb:vortex-compact 40943040 42163260 0.97
tpcds_q09/duckdb:vortex-compact 20323796 20018850 1.02
tpcds_q10/duckdb:vortex-compact 52125434 52616371 0.99
tpcds_q11/duckdb:vortex-compact 73807807 71383569 1.03
tpcds_q12/duckdb:vortex-compact 21244069 22476772 0.95
tpcds_q13/duckdb:vortex-compact 53721192 52235541 1.03
tpcds_q14/duckdb:vortex-compact 117056872 120668658 0.97
tpcds_q15/duckdb:vortex-compact 29240405 29252425 1.00
tpcds_q16/duckdb:vortex-compact 26467845 26254669 1.01
tpcds_q17/duckdb:vortex-compact 54792969 54627813 1.00
tpcds_q18/duckdb:vortex-compact 47209536 49358296 0.96
tpcds_q19/duckdb:vortex-compact 43748555 43428065 1.01
tpcds_q20/duckdb:vortex-compact 20318810 20736437 0.98
tpcds_q21/duckdb:vortex-compact 17791248 18210844 0.98
tpcds_q22/duckdb:vortex-compact 79594925 77822052 1.02
tpcds_q23/duckdb:vortex-compact 🚨 138742244 114089028 1.22
tpcds_q24/duckdb:vortex-compact 57012542 57340032 0.99
tpcds_q25/duckdb:vortex-compact 78458710 76113807 1.03
tpcds_q26/duckdb:vortex-compact 31867008 29569488 1.08
tpcds_q27/duckdb:vortex-compact 36659659 35420742 1.03
tpcds_q28/duckdb:vortex-compact 33789322 33928027 1.00
tpcds_q29/duckdb:vortex-compact 53682644 54195092 0.99
tpcds_q30/duckdb:vortex-compact 30075096 29854883 1.01
tpcds_q31/duckdb:vortex-compact 35832886 36343203 0.99
tpcds_q32/duckdb:vortex-compact 20425085 20162565 1.01
tpcds_q33/duckdb:vortex-compact 33526731 32786482 1.02
tpcds_q34/duckdb:vortex-compact 29963020 29700046 1.01
tpcds_q35/duckdb:vortex-compact 75068624 73941653 1.02
tpcds_q36/duckdb:vortex-compact 36849481 36116739 1.02
tpcds_q37/duckdb:vortex-compact 23447195 23593426 0.99
tpcds_q38/duckdb:vortex-compact 40390941 40955444 0.99
tpcds_q39/duckdb:vortex-compact 37485932 38260905 0.98
tpcds_q40/duckdb:vortex-compact 23884287 25933568 0.92
tpcds_q41/duckdb:vortex-compact 12288509 11513332 1.07
tpcds_q42/duckdb:vortex-compact 19194648 19494320 0.98
tpcds_q43/duckdb:vortex-compact 31789131 31527836 1.01
tpcds_q44/duckdb:vortex-compact 28662302 29292588 0.98
tpcds_q45/duckdb:vortex-compact 36342571 35816853 1.01
tpcds_q46/duckdb:vortex-compact 46508534 46412712 1.00
tpcds_q47/duckdb:vortex-compact 62068251 63044061 0.98
tpcds_q48/duckdb:vortex-compact 44985820 45525269 0.99
tpcds_q49/duckdb:vortex-compact 47274119 44471141 1.06
tpcds_q50/duckdb:vortex-compact 36736689 36754684 1.00
tpcds_q51/duckdb:vortex-compact 112389030 111246141 1.01
tpcds_q52/duckdb:vortex-compact 18618345 19547820 0.95
tpcds_q53/duckdb:vortex-compact 32804715 32207978 1.02
tpcds_q54/duckdb:vortex-compact 38917647 36834822 1.06
tpcds_q55/duckdb:vortex-compact 18492150 18697727 0.99
tpcds_q56/duckdb:vortex-compact 31563376 31401782 1.01
tpcds_q57/duckdb:vortex-compact 44792041 45461555 0.99
tpcds_q58/duckdb:vortex-compact 37798985 36922049 1.02
tpcds_q59/duckdb:vortex-compact 86855011 86722373 1.00
tpcds_q60/duckdb:vortex-compact 34045600 34520094 0.99
tpcds_q61/duckdb:vortex-compact 52685866 53727774 0.98
tpcds_q62/duckdb:vortex-compact 21882890 20829483 1.05
tpcds_q63/duckdb:vortex-compact 30979551 30880058 1.00
tpcds_q64/duckdb:vortex-compact 134822660 132795965 1.02
tpcds_q65/duckdb:vortex-compact 30446972 30066694 1.01
tpcds_q66/duckdb:vortex-compact 34588144 34865130 0.99
tpcds_q67/duckdb:vortex-compact 148219262 160670484 0.92
tpcds_q68/duckdb:vortex-compact 47604599 47354536 1.01
tpcds_q69/duckdb:vortex-compact 54668560 54317342 1.01
tpcds_q70/duckdb:vortex-compact 59407399 58088615 1.02
tpcds_q71/duckdb:vortex-compact 28834269 30590471 0.94
tpcds_q72/duckdb:vortex-compact 182623675 182240662 1.00
tpcds_q73/duckdb:vortex-compact 28338785 28815033 0.98
tpcds_q74/duckdb:vortex-compact 50849383 49177351 1.03
tpcds_q75/duckdb:vortex-compact 60132745 59919924 1.00
tpcds_q76/duckdb:vortex-compact 28392788 28991926 0.98
tpcds_q77/duckdb:vortex-compact 37353506 35890238 1.04
tpcds_q78/duckdb:vortex-compact 89460719 82708522 1.08
tpcds_q79/duckdb:vortex-compact 39691989 40434852 0.98
tpcds_q80/duckdb:vortex-compact 69481853 69464486 1.00
tpcds_q81/duckdb:vortex-compact 34790208 35860985 0.97
tpcds_q82/duckdb:vortex-compact 49320814 49242212 1.00
tpcds_q83/duckdb:vortex-compact 35007640 34196015 1.02
tpcds_q84/duckdb:vortex-compact 27880283 27617575 1.01
tpcds_q85/duckdb:vortex-compact 58829749 57819393 1.02
tpcds_q86/duckdb:vortex-compact 🚀 20659139 23122996 0.89
tpcds_q87/duckdb:vortex-compact 43970927 43555060 1.01
tpcds_q88/duckdb:vortex-compact 74768804 77103104 0.97
tpcds_q89/duckdb:vortex-compact 32114647 32912551 0.98
tpcds_q90/duckdb:vortex-compact 10534676 10420088 1.01
tpcds_q91/duckdb:vortex-compact 42734934 43833933 0.97
tpcds_q92/duckdb:vortex-compact 48482578 45927342 1.06
tpcds_q93/duckdb:vortex-compact 31767380 32284798 0.98
tpcds_q94/duckdb:vortex-compact 26810347 27302640 0.98
tpcds_q95/duckdb:vortex-compact 164255337 159019890 1.03
tpcds_q96/duckdb:vortex-compact 15928167 15745274 1.01
tpcds_q97/duckdb:vortex-compact 43946359 43055500 1.02
tpcds_q98/duckdb:vortex-compact 27298927 27356556 1.00
tpcds_q99/duckdb:vortex-compact 28385700 28198307 1.01
duckdb / parquet (0.998x ➖, 1↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 31144575 29384849 1.06
tpcds_q02/duckdb:parquet 24320660 24646252 0.99
tpcds_q03/duckdb:parquet 13552000 12744405 1.06
tpcds_q04/duckdb:parquet 169240239 166685034 1.02
tpcds_q05/duckdb:parquet 31178753 31477811 0.99
tpcds_q06/duckdb:parquet 32852113 34506875 0.95
tpcds_q07/duckdb:parquet 24240343 24530946 0.99
tpcds_q08/duckdb:parquet 29661287 29374202 1.01
tpcds_q09/duckdb:parquet 44327210 45214667 0.98
tpcds_q10/duckdb:parquet 37843835 38113834 0.99
tpcds_q11/duckdb:parquet 88294861 92134194 0.96
tpcds_q12/duckdb:parquet 16913759 17041893 0.99
tpcds_q13/duckdb:parquet 34954249 34785496 1.00
tpcds_q14/duckdb:parquet 104009748 104634469 0.99
tpcds_q15/duckdb:parquet 30435840 30147109 1.01
tpcds_q16/duckdb:parquet 22509902 22215636 1.01
tpcds_q17/duckdb:parquet 38400353 38013484 1.01
tpcds_q18/duckdb:parquet 47746252 48178927 0.99
tpcds_q19/duckdb:parquet 31750520 31557195 1.01
tpcds_q20/duckdb:parquet 18541170 18504787 1.00
tpcds_q21/duckdb:parquet 11631707 12397100 0.94
tpcds_q22/duckdb:parquet 70245319 69641489 1.01
tpcds_q23/duckdb:parquet 81201014 80476580 1.01
tpcds_q24/duckdb:parquet 47362834 46811598 1.01
tpcds_q25/duckdb:parquet 35573194 35427625 1.00
tpcds_q26/duckdb:parquet 39400059 39549711 1.00
tpcds_q27/duckdb:parquet 53331675 53546040 1.00
tpcds_q28/duckdb:parquet 42691872 43378941 0.98
tpcds_q29/duckdb:parquet 37077240 36394135 1.02
tpcds_q30/duckdb:parquet 37433161 37629414 0.99
tpcds_q31/duckdb:parquet 27370758 28296010 0.97
tpcds_q32/duckdb:parquet 12427338 12622462 0.98
tpcds_q33/duckdb:parquet 23997529 24440357 0.98
tpcds_q34/duckdb:parquet 23093906 21985468 1.05
tpcds_q35/duckdb:parquet 59527875 61612817 0.97
tpcds_q36/duckdb:parquet 22874267 22736477 1.01
tpcds_q37/duckdb:parquet 13944451 14219062 0.98
tpcds_q38/duckdb:parquet 36565238 36282504 1.01
tpcds_q39/duckdb:parquet 32066563 32338440 0.99
tpcds_q40/duckdb:parquet 19740405 19130879 1.03
tpcds_q41/duckdb:parquet 8709905 8770828 0.99
tpcds_q42/duckdb:parquet 12772569 12467038 1.02
tpcds_q43/duckdb:parquet 17588414 17724397 0.99
tpcds_q44/duckdb:parquet 25712919 26848065 0.96
tpcds_q45/duckdb:parquet 28334034 28582339 0.99
tpcds_q46/duckdb:parquet 47449536 47116021 1.01
tpcds_q47/duckdb:parquet 49148430 49600161 0.99
tpcds_q48/duckdb:parquet 32576629 32517449 1.00
tpcds_q49/duckdb:parquet 28180538 28283289 1.00
tpcds_q50/duckdb:parquet 26300016 25920360 1.01
tpcds_q51/duckdb:parquet 105194186 105141838 1.00
tpcds_q52/duckdb:parquet 12127841 12761986 0.95
tpcds_q53/duckdb:parquet 19015232 19824192 0.96
tpcds_q54/duckdb:parquet 28357754 28749290 0.99
tpcds_q55/duckdb:parquet 13420750 12688944 1.06
tpcds_q56/duckdb:parquet 23984615 23154648 1.04
tpcds_q57/duckdb:parquet 37916211 37681735 1.01
tpcds_q58/duckdb:parquet 25715269 25820265 1.00
tpcds_q59/duckdb:parquet 36244141 36461186 0.99
tpcds_q60/duckdb:parquet 25255726 25193999 1.00
tpcds_q61/duckdb:parquet 33056805 32248560 1.03
tpcds_q62/duckdb:parquet 12721279 12550298 1.01
tpcds_q63/duckdb:parquet 17217100 17642733 0.98
tpcds_q64/duckdb:parquet 80335502 80624571 1.00
tpcds_q65/duckdb:parquet 22503564 21843119 1.03
tpcds_q66/duckdb:parquet 28963727 29276538 0.99
tpcds_q67/duckdb:parquet 134712110 139481278 0.97
tpcds_q68/duckdb:parquet 40923935 38849792 1.05
tpcds_q69/duckdb:parquet 38752486 38387928 1.01
tpcds_q70/duckdb:parquet 22173746 22315950 0.99
tpcds_q71/duckdb:parquet 23976066 22507410 1.07
tpcds_q72/duckdb:parquet 167433764 165620345 1.01
tpcds_q73/duckdb:parquet 20240960 21086562 0.96
tpcds_q74/duckdb:parquet 126644655 126279909 1.00
tpcds_q75/duckdb:parquet 57776361 58230466 0.99
tpcds_q76/duckdb:parquet 22102158 22341242 0.99
tpcds_q77/duckdb:parquet 25720436 25802280 1.00
tpcds_q78/duckdb:parquet 77301927 76985229 1.00
tpcds_q79/duckdb:parquet 30401141 30605977 0.99
tpcds_q80/duckdb:parquet 42769782 45984064 0.93
tpcds_q81/duckdb:parquet 35041192 35331669 0.99
tpcds_q82/duckdb:parquet 17049520 16671278 1.02
tpcds_q83/duckdb:parquet 18130942 18220302 1.00
tpcds_q84/duckdb:parquet 20424059 20428803 1.00
tpcds_q85/duckdb:parquet 42349347 42318962 1.00
tpcds_q86/duckdb:parquet 13914390 13427154 1.04
tpcds_q87/duckdb:parquet 38833269 39214164 0.99
tpcds_q88/duckdb:parquet 54215353 53300927 1.02
tpcds_q89/duckdb:parquet 21914826 21194520 1.03
tpcds_q90/duckdb:parquet 8226947 8349725 0.99
tpcds_q91/duckdb:parquet 25452765 24695440 1.03
tpcds_q92/duckdb:parquet 13944099 12811131 1.09
tpcds_q93/duckdb:parquet 31868448 31650644 1.01
tpcds_q94/duckdb:parquet 17715977 17933514 0.99
tpcds_q95/duckdb:parquet 🚀 124577885 147780948 0.84
tpcds_q96/duckdb:parquet 10750275 10539114 1.02
tpcds_q97/duckdb:parquet 37415297 38052343 0.98
tpcds_q98/duckdb:parquet 24290509 24734170 0.98
tpcds_q99/duckdb:parquet 19892583 20699115 0.96
duckdb / duckdb (0.983x ➖, 3↑ 1↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 22062446 22125436 1.00
tpcds_q02/duckdb:duckdb 19815024 20045122 0.99
tpcds_q03/duckdb:duckdb 10249702 10468591 0.98
tpcds_q04/duckdb:duckdb 174468972 174934307 1.00
tpcds_q05/duckdb:duckdb 20047460 21324551 0.94
tpcds_q06/duckdb:duckdb 27976682 27762498 1.01
tpcds_q07/duckdb:duckdb 40345625 40114046 1.01
tpcds_q08/duckdb:duckdb 120536044 119707590 1.01
tpcds_q09/duckdb:duckdb 20490205 20457008 1.00
tpcds_q10/duckdb:duckdb 28241622 27856573 1.01
tpcds_q11/duckdb:duckdb 87491118 90411069 0.97
tpcds_q12/duckdb:duckdb 13963780 13881680 1.01
tpcds_q13/duckdb:duckdb 26189568 26354451 0.99
tpcds_q14/duckdb:duckdb 92669652 94916065 0.98
tpcds_q15/duckdb:duckdb 24650199 24122665 1.02
tpcds_q16/duckdb:duckdb 20342443 21072819 0.97
tpcds_q17/duckdb:duckdb 23859941 24761062 0.96
tpcds_q18/duckdb:duckdb 47315521 46551014 1.02
tpcds_q19/duckdb:duckdb 19044421 19874594 0.96
tpcds_q20/duckdb:duckdb 14136193 13806670 1.02
tpcds_q21/duckdb:duckdb 7416180 7461465 0.99
tpcds_q22/duckdb:duckdb 64997136 63257237 1.03
tpcds_q23/duckdb:duckdb 78372619 78283348 1.00
tpcds_q24/duckdb:duckdb 25640574 25533346 1.00
tpcds_q25/duckdb:duckdb 18664735 18621093 1.00
tpcds_q26/duckdb:duckdb 28344612 29032411 0.98
tpcds_q27/duckdb:duckdb 40329339 40858423 0.99
tpcds_q28/duckdb:duckdb 25152605 26348868 0.95
tpcds_q29/duckdb:duckdb 23439933 23753216 0.99
tpcds_q30/duckdb:duckdb 29188186 30826160 0.95
tpcds_q31/duckdb:duckdb 50609877 51277608 0.99
tpcds_q32/duckdb:duckdb 8574350 8121272 1.06
tpcds_q33/duckdb:duckdb 🚀 15050616 16828276 0.89
tpcds_q34/duckdb:duckdb 18509287 18652663 0.99
tpcds_q35/duckdb:duckdb 38021935 37438297 1.02
tpcds_q36/duckdb:duckdb 71210003 70162076 1.01
tpcds_q37/duckdb:duckdb 8758067 8486821 1.03
tpcds_q38/duckdb:duckdb 33102951 33411883 0.99
tpcds_q39/duckdb:duckdb 28112044 27744798 1.01
tpcds_q40/duckdb:duckdb 14504367 14590339 0.99
tpcds_q41/duckdb:duckdb 9179464 10146929 0.90
tpcds_q42/duckdb:duckdb 9258384 9841636 0.94
tpcds_q43/duckdb:duckdb 14805762 15090439 0.98
tpcds_q44/duckdb:duckdb 15424719 14415830 1.07
tpcds_q45/duckdb:duckdb 19065436 18746373 1.02
tpcds_q46/duckdb:duckdb 38230426 38969438 0.98
tpcds_q47/duckdb:duckdb 45535508 46842769 0.97
tpcds_q48/duckdb:duckdb 25102559 24664052 1.02
tpcds_q49/duckdb:duckdb 20663217 21005773 0.98
tpcds_q50/duckdb:duckdb 16152424 16274250 0.99
tpcds_q51/duckdb:duckdb 97657397 99667277 0.98
tpcds_q52/duckdb:duckdb 🚀 8759676 11297036 0.78
tpcds_q53/duckdb:duckdb 17805583 17776592 1.00
tpcds_q54/duckdb:duckdb 18847480 18969213 0.99
tpcds_q55/duckdb:duckdb 10243078 10486338 0.98
tpcds_q56/duckdb:duckdb 16729426 16914614 0.99
tpcds_q57/duckdb:duckdb 35907879 36372826 0.99
tpcds_q58/duckdb:duckdb 16702451 16308763 1.02
tpcds_q59/duckdb:duckdb 36753074 36731527 1.00
tpcds_q60/duckdb:duckdb 18035855 18857808 0.96
tpcds_q61/duckdb:duckdb 16345234 17444297 0.94
tpcds_q62/duckdb:duckdb 9778089 9863312 0.99
tpcds_q63/duckdb:duckdb 15955505 16894271 0.94
tpcds_q64/duckdb:duckdb 57508675 58351909 0.99
tpcds_q65/duckdb:duckdb 36358592 36737109 0.99
tpcds_q66/duckdb:duckdb 26345686 26881453 0.98
tpcds_q67/duckdb:duckdb 132022279 132866357 0.99
tpcds_q68/duckdb:duckdb 26177110 27002416 0.97
tpcds_q69/duckdb:duckdb 27694427 28923043 0.96
tpcds_q70/duckdb:duckdb 16402145 17387484 0.94
tpcds_q71/duckdb:duckdb 16206798 16771210 0.97
tpcds_q72/duckdb:duckdb 45756902 45247206 1.01
tpcds_q73/duckdb:duckdb 13759720 14346273 0.96
tpcds_q74/duckdb:duckdb 146079915 145745643 1.00
tpcds_q75/duckdb:duckdb 45752899 46316449 0.99
tpcds_q76/duckdb:duckdb 14849040 14825833 1.00
tpcds_q77/duckdb:duckdb 14913348 16099705 0.93
tpcds_q78/duckdb:duckdb 64682870 66198621 0.98
tpcds_q79/duckdb:duckdb 20100035 20425761 0.98
tpcds_q80/duckdb:duckdb 32026851 32380135 0.99
tpcds_q81/duckdb:duckdb 39452800 40726204 0.97
tpcds_q82/duckdb:duckdb 10666118 10659505 1.00
tpcds_q83/duckdb:duckdb 10666323 10773422 0.99
tpcds_q84/duckdb:duckdb 14507100 14575798 1.00
tpcds_q85/duckdb:duckdb 26325782 25873266 1.02
tpcds_q86/duckdb:duckdb 11939048 12254785 0.97
tpcds_q87/duckdb:duckdb 🚨 40024826 35910329 1.11
tpcds_q88/duckdb:duckdb 28295966 30483812 0.93
tpcds_q89/duckdb:duckdb 21842520 22127526 0.99
tpcds_q90/duckdb:duckdb 6137495 6214138 0.99
tpcds_q91/duckdb:duckdb 14044815 15090473 0.93
tpcds_q92/duckdb:duckdb 9830882 10093519 0.97
tpcds_q93/duckdb:duckdb 23318572 23987526 0.97
tpcds_q94/duckdb:duckdb 14537593 14272868 1.02
tpcds_q95/duckdb:duckdb 🚀 111234934 130945914 0.85
tpcds_q96/duckdb:duckdb 5711664 5921457 0.96
tpcds_q97/duckdb:duckdb 31914108 31962460 1.00
tpcds_q98/duckdb:duckdb 20695286 20845164 0.99
tpcds_q99/duckdb:duckdb 16690760 16678595 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -0.9% +1.8% -2.6% +21.6% ➖ noise
1 datafusion:vortex-file-compressed -7.4% +1.8% -9.0% +22.3% ➖ noise
1 duckdb:duckdb -0.3% +1.8% -2.0% +21.8% ➖ noise
1 duckdb:vortex-compact -2.4% +1.8% -4.1% +23.7% ➖ noise
1 duckdb:vortex-file-compressed -1.5% +1.8% -3.2% +27.0% ➖ noise
2 datafusion:vortex-compact -0.4% +0.7% -1.1% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.9% +0.7% -1.5% +10.0% ➖ noise
2 duckdb:duckdb -1.1% +0.7% -1.8% +10.0% ➖ noise
2 duckdb:vortex-compact +38.4% +0.7% +37.4% +19.4% 🚨 regression
2 duckdb:vortex-file-compressed +0.2% +0.7% -0.5% +17.6% ➖ noise
3 datafusion:vortex-compact +0.4% +1.9% -1.5% +15.1% ➖ noise
3 datafusion:vortex-file-compressed +1.6% +1.9% -0.3% +10.0% ➖ noise
3 duckdb:duckdb -2.1% +1.9% -3.9% +11.4% ➖ noise
3 duckdb:vortex-compact +2.9% +1.9% +1.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.1% +1.9% -1.8% +10.0% ➖ noise
4 datafusion:vortex-compact +1.2% -1.9% +3.2% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +1.6% -1.9% +3.6% +10.0% ➖ noise
4 duckdb:duckdb -0.3% -1.9% +1.7% +10.0% ➖ noise
4 duckdb:vortex-compact +1.8% -1.9% +3.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.0% -1.9% +3.0% +10.9% ➖ noise
5 datafusion:vortex-compact +2.9% -1.0% +3.9% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -2.6% -1.0% -1.6% +10.0% ➖ noise
5 duckdb:duckdb -6.0% -1.0% -5.0% +13.6% ➖ noise
5 duckdb:vortex-compact +7.1% -1.0% +8.3% +13.4% ➖ noise
5 duckdb:vortex-file-compressed -3.0% -1.0% -2.0% +11.4% ➖ noise
6 datafusion:vortex-compact -5.8% -3.3% -2.6% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +3.7% -3.3% +7.2% +10.0% ➖ noise
6 duckdb:duckdb +0.8% -3.3% +4.2% +10.0% ➖ noise
6 duckdb:vortex-compact -2.3% -3.3% +1.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.2% -3.3% +2.2% +15.9% ➖ noise
7 datafusion:vortex-compact -0.2% +2.0% -2.2% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +5.3% +2.0% +3.3% +10.2% ➖ noise
7 duckdb:duckdb +0.6% +2.0% -1.4% +10.0% ➖ noise
7 duckdb:vortex-compact -0.2% +2.0% -2.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -2.7% +2.0% -4.6% +10.0% ➖ noise
8 datafusion:vortex-compact +0.2% +2.4% -2.1% +13.5% ➖ noise
8 datafusion:vortex-file-compressed +4.7% +2.4% +2.2% +10.0% ➖ noise
8 duckdb:duckdb +0.7% +2.4% -1.7% +10.0% ➖ noise
8 duckdb:vortex-compact -2.9% +2.4% -5.2% +12.6% ➖ noise
8 duckdb:vortex-file-compressed +0.7% +2.4% -1.7% +16.6% ➖ noise
9 datafusion:vortex-compact +2.4% -1.2% +3.6% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +2.4% -1.2% +3.6% +10.0% ➖ noise
9 duckdb:duckdb +0.2% -1.2% +1.3% +10.0% ➖ noise
9 duckdb:vortex-compact +1.5% -1.2% +2.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +7.4% -1.2% +8.7% +20.7% ➖ noise
10 datafusion:vortex-compact -4.5% +0.7% -5.2% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -1.1% +0.7% -1.7% +10.0% ➖ noise
10 duckdb:duckdb +1.4% +0.7% +0.7% +10.0% ➖ noise
10 duckdb:vortex-compact -0.9% +0.7% -1.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.3% +0.7% -1.9% +10.0% ➖ noise
11 datafusion:vortex-compact -0.0% -3.3% +3.4% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -2.6% -3.3% +0.7% +10.0% ➖ noise
11 duckdb:duckdb -3.2% -3.3% +0.1% +13.0% ➖ noise
11 duckdb:vortex-compact +3.4% -3.3% +7.0% +13.2% ➖ noise
11 duckdb:vortex-file-compressed -2.8% -3.3% +0.6% +10.0% ➖ noise
12 datafusion:vortex-compact -1.4% -1.3% -0.0% +12.6% ➖ noise
12 datafusion:vortex-file-compressed +5.8% -1.3% +7.3% +12.0% ➖ noise
12 duckdb:duckdb +0.6% -1.3% +2.0% +10.0% ➖ noise
12 duckdb:vortex-compact -5.5% -1.3% -4.2% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +0.7% -1.3% +2.1% +26.6% ➖ noise
13 datafusion:vortex-compact +0.0% +0.1% -0.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.8% +0.1% -1.9% +10.0% ➖ noise
13 duckdb:duckdb -0.6% +0.1% -0.7% +10.0% ➖ noise
13 duckdb:vortex-compact +2.8% +0.1% +2.8% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -5.2% +0.1% -5.3% +13.6% ➖ noise
14 datafusion:vortex-compact +0.7% -0.4% +1.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -0.1% -0.4% +0.3% +10.0% ➖ noise
14 duckdb:duckdb -2.4% -0.4% -2.0% +10.0% ➖ noise
14 duckdb:vortex-compact -3.0% -0.4% -2.6% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -1.4% -0.4% -1.1% +10.0% ➖ noise
15 datafusion:vortex-compact -0.9% -0.6% -0.3% +11.5% ➖ noise
15 datafusion:vortex-file-compressed -0.4% -0.6% +0.2% +13.3% ➖ noise
15 duckdb:duckdb +2.2% -0.6% +2.8% +10.0% ➖ noise
15 duckdb:vortex-compact -0.0% -0.6% +0.6% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -5.6% -0.6% -5.0% +17.2% ➖ noise
16 datafusion:vortex-compact -3.7% -1.1% -2.6% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -0.6% -1.1% +0.4% +10.3% ➖ noise
16 duckdb:duckdb -3.5% -1.1% -2.4% +10.0% ➖ noise
16 duckdb:vortex-compact +0.8% -1.1% +1.9% +14.7% ➖ noise
16 duckdb:vortex-file-compressed +3.6% -1.1% +4.7% +10.8% ➖ noise
17 datafusion:vortex-compact -3.2% -3.1% -0.1% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.9% -3.1% +4.1% +11.6% ➖ noise
17 duckdb:duckdb -3.6% -3.1% -0.5% +10.0% ➖ noise
17 duckdb:vortex-compact +0.3% -3.1% +3.6% +20.7% ➖ noise
17 duckdb:vortex-file-compressed -0.7% -3.1% +2.5% +13.5% ➖ noise
18 datafusion:vortex-compact +2.8% -2.5% +5.5% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -1.2% -2.5% +1.4% +10.0% ➖ noise
18 duckdb:duckdb +1.6% -2.5% +4.3% +10.0% ➖ noise
18 duckdb:vortex-compact -4.4% -2.5% -1.9% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.8% -2.5% +0.8% +10.0% ➖ noise
19 datafusion:vortex-compact +2.4% -0.6% +3.0% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -4.5% -0.6% -3.9% +12.1% ➖ noise
19 duckdb:duckdb -4.2% -0.6% -3.6% +10.0% ➖ noise
19 duckdb:vortex-compact +0.7% -0.6% +1.3% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -1.4% -0.6% -0.9% +18.8% ➖ noise
20 datafusion:vortex-compact +1.8% +0.5% +1.3% +13.3% ➖ noise
20 datafusion:vortex-file-compressed -3.1% +0.5% -3.5% +10.3% ➖ noise
20 duckdb:duckdb +2.4% +0.5% +1.9% +10.0% ➖ noise
20 duckdb:vortex-compact -2.0% +0.5% -2.5% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +0.2% +0.5% -0.3% +10.0% ➖ noise
21 datafusion:vortex-compact +0.7% +0.7% -0.1% +11.6% ➖ noise
21 datafusion:vortex-file-compressed +2.3% +0.7% +1.6% +11.8% ➖ noise
21 duckdb:duckdb -0.6% +0.7% -1.3% +15.7% ➖ noise
21 duckdb:vortex-compact -2.3% +0.7% -3.0% +28.7% ➖ noise
21 duckdb:vortex-file-compressed -2.0% +0.7% -2.7% +15.0% ➖ noise
22 datafusion:vortex-compact +4.9% -9.4% +15.8% +15.6% 🚨 regression
22 datafusion:vortex-file-compressed +30.4% -9.4% +44.0% +29.6% 🚨 regression
22 duckdb:duckdb +2.8% -9.4% +13.4% +13.1% 🚨 regression
22 duckdb:vortex-compact +2.3% -9.4% +12.9% +13.4% ➖ noise
22 duckdb:vortex-file-compressed +1.2% -9.4% +11.7% +14.2% ➖ noise
23 datafusion:vortex-compact -0.8% +2.9% -3.6% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -1.2% +2.9% -4.0% +10.0% ➖ noise
23 duckdb:duckdb +0.1% +2.9% -2.7% +12.0% ➖ noise
23 duckdb:vortex-compact +21.6% +2.9% +18.2% +17.7% 🚨 regression
23 duckdb:vortex-file-compressed +6.8% +2.9% +3.7% +16.9% ➖ noise
24 datafusion:vortex-compact -4.4% +0.1% -4.4% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -1.6% +0.1% -1.6% +10.0% ➖ noise
24 duckdb:duckdb +0.4% +0.1% +0.4% +10.0% ➖ noise
24 duckdb:vortex-compact -0.6% +0.1% -0.6% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +3.0% +0.1% +2.9% +10.0% ➖ noise
25 datafusion:vortex-compact -4.0% +0.4% -4.4% +12.1% ➖ noise
25 datafusion:vortex-file-compressed +3.5% +0.4% +3.1% +10.0% ➖ noise
25 duckdb:duckdb +0.2% +0.4% -0.1% +21.5% ➖ noise
25 duckdb:vortex-compact +3.1% +0.4% +2.7% +10.9% ➖ noise
25 duckdb:vortex-file-compressed +0.0% +0.4% -0.4% +21.6% ➖ noise
26 datafusion:vortex-compact +0.4% -0.1% +0.5% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +1.8% -0.1% +1.9% +10.0% ➖ noise
26 duckdb:duckdb -2.4% -0.1% -2.3% +10.0% ➖ noise
26 duckdb:vortex-compact +7.8% -0.1% +7.9% +17.3% ➖ noise
26 duckdb:vortex-file-compressed -0.5% -0.1% -0.4% +10.0% ➖ noise
27 datafusion:vortex-compact -4.9% -1.3% -3.6% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -2.5% -1.3% -1.2% +10.9% ➖ noise
27 duckdb:duckdb -1.3% -1.3% +0.0% +10.0% ➖ noise
27 duckdb:vortex-compact +3.5% -1.3% +4.9% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +1.0% -1.3% +2.4% +10.0% ➖ noise
28 datafusion:vortex-compact -1.1% -1.2% +0.1% +10.3% ➖ noise
28 datafusion:vortex-file-compressed -3.1% -1.2% -1.9% +10.0% ➖ noise
28 duckdb:duckdb -4.5% -1.2% -3.3% +10.0% ➖ noise
28 duckdb:vortex-compact -0.4% -1.2% +0.8% +28.7% ➖ noise
28 duckdb:vortex-file-compressed -2.5% -1.2% -1.3% +10.0% ➖ noise
29 datafusion:vortex-compact -6.4% -1.2% -5.3% +10.1% ➖ noise
29 datafusion:vortex-file-compressed +1.8% -1.2% +3.0% +11.8% ➖ noise
29 duckdb:duckdb -1.3% -1.2% -0.2% +10.0% ➖ noise
29 duckdb:vortex-compact -0.9% -1.2% +0.2% +13.5% ➖ noise
29 duckdb:vortex-file-compressed +1.0% -1.2% +2.1% +10.0% ➖ noise
30 datafusion:vortex-compact -2.6% +2.5% -5.0% +10.0% ➖ noise
30 datafusion:vortex-file-compressed -2.3% +2.5% -4.7% +10.0% ➖ noise
30 duckdb:duckdb -5.3% +2.5% -7.7% +10.0% ➖ noise
30 duckdb:vortex-compact +0.7% +2.5% -1.8% +10.3% ➖ noise
30 duckdb:vortex-file-compressed -2.5% +2.5% -4.9% +20.6% ➖ noise
31 datafusion:vortex-compact +0.4% -2.1% +2.5% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -2.7% -2.1% -0.6% +10.0% ➖ noise
31 duckdb:duckdb -1.3% -2.1% +0.8% +10.0% ➖ noise
31 duckdb:vortex-compact -1.4% -2.1% +0.7% +10.4% ➖ noise
31 duckdb:vortex-file-compressed -3.4% -2.1% -1.4% +13.4% ➖ noise
32 datafusion:vortex-compact -4.0% -0.5% -3.5% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +4.7% -0.5% +5.2% +10.0% ➖ noise
32 duckdb:duckdb +5.6% -0.5% +6.1% +10.0% ➖ noise
32 duckdb:vortex-compact +1.3% -0.5% +1.8% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -2.2% -0.5% -1.7% +11.3% ➖ noise
33 datafusion:vortex-compact -4.7% -2.3% -2.4% +13.4% ➖ noise
33 datafusion:vortex-file-compressed +6.0% -2.3% +8.5% +10.0% ➖ noise
33 duckdb:duckdb -10.6% -2.3% -8.4% +10.4% ➖ noise
33 duckdb:vortex-compact +2.3% -2.3% +4.7% +16.0% ➖ noise
33 duckdb:vortex-file-compressed -2.2% -2.3% +0.1% +10.0% ➖ noise
34 datafusion:vortex-compact +0.2% -0.0% +0.2% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -0.1% -0.0% -0.0% +11.1% ➖ noise
34 duckdb:duckdb -0.8% -0.0% -0.8% +10.0% ➖ noise
34 duckdb:vortex-compact +0.9% -0.0% +0.9% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -1.0% -0.0% -0.9% +10.0% ➖ noise
35 datafusion:vortex-compact -1.6% -1.7% +0.1% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -1.9% -1.7% -0.2% +10.0% ➖ noise
35 duckdb:duckdb +1.6% -1.7% +3.3% +10.4% ➖ noise
35 duckdb:vortex-compact +1.5% -1.7% +3.3% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -1.4% -1.7% +0.3% +10.0% ➖ noise
36 datafusion:vortex-compact -3.9% +0.9% -4.8% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -4.2% +0.9% -5.0% +10.0% ➖ noise
36 duckdb:duckdb +1.5% +0.9% +0.6% +10.0% ➖ noise
36 duckdb:vortex-compact +2.0% +0.9% +1.2% +16.3% ➖ noise
36 duckdb:vortex-file-compressed +0.4% +0.9% -0.5% +10.0% ➖ noise
37 datafusion:vortex-compact -1.8% -1.6% -0.2% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -1.9% -1.6% -0.3% +10.0% ➖ noise
37 duckdb:duckdb +3.2% -1.6% +4.8% +10.0% ➖ noise
37 duckdb:vortex-compact -0.6% -1.6% +0.9% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +3.1% -1.6% +4.8% +10.0% ➖ noise
38 datafusion:vortex-compact -1.8% +2.0% -3.7% +10.3% ➖ noise
38 datafusion:vortex-file-compressed -2.1% +2.0% -4.0% +15.2% ➖ noise
38 duckdb:duckdb -0.9% +2.0% -2.8% +10.6% ➖ noise
38 duckdb:vortex-compact -1.4% +2.0% -3.3% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -1.1% +2.0% -3.0% +10.3% ➖ noise
39 datafusion:vortex-compact -0.0% -0.3% +0.3% +10.0% ➖ noise
39 datafusion:vortex-file-compressed +1.3% -0.3% +1.6% +10.0% ➖ noise
39 duckdb:duckdb +1.3% -0.3% +1.6% +11.6% ➖ noise
39 duckdb:vortex-compact -2.0% -0.3% -1.8% +12.6% ➖ noise
39 duckdb:vortex-file-compressed +1.0% -0.3% +1.3% +19.0% ➖ noise
40 datafusion:vortex-compact -2.4% +1.2% -3.6% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +0.1% +1.2% -1.2% +10.3% ➖ noise
40 duckdb:duckdb -0.6% +1.2% -1.8% +10.0% ➖ noise
40 duckdb:vortex-compact -7.9% +1.2% -9.0% +13.6% ➖ noise
40 duckdb:vortex-file-compressed -4.3% +1.2% -5.5% +10.0% ➖ noise
41 datafusion:vortex-compact +1.0% -0.6% +1.6% +10.0% ➖ noise
41 datafusion:vortex-file-compressed -0.1% -0.6% +0.5% +10.0% ➖ noise
41 duckdb:duckdb -9.5% -0.6% -9.0% +10.0% ➖ noise
41 duckdb:vortex-compact +6.7% -0.6% +7.4% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -3.1% -0.6% -2.5% +10.0% ➖ noise
42 datafusion:vortex-compact -1.7% +4.1% -5.6% +10.0% ➖ noise
42 datafusion:vortex-file-compressed -0.4% +4.1% -4.4% +10.1% ➖ noise
42 duckdb:duckdb -5.9% +4.1% -9.7% +17.4% ➖ noise
42 duckdb:vortex-compact -1.5% +4.1% -5.4% +11.7% ➖ noise
42 duckdb:vortex-file-compressed -2.5% +4.1% -6.4% +17.3% ➖ noise
43 datafusion:vortex-compact +2.3% -0.2% +2.5% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -1.8% -0.2% -1.6% +10.0% ➖ noise
43 duckdb:duckdb -1.9% -0.2% -1.7% +10.0% ➖ noise
43 duckdb:vortex-compact +0.8% -0.2% +1.1% +18.0% ➖ noise
43 duckdb:vortex-file-compressed -14.8% -0.2% -14.6% +22.4% ➖ noise
44 datafusion:vortex-compact -2.0% -2.8% +0.8% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -1.7% -2.8% +1.2% +10.8% ➖ noise
44 duckdb:duckdb +7.0% -2.8% +10.1% +10.0% 🚨 regression
44 duckdb:vortex-compact -2.2% -2.8% +0.7% +10.0% ➖ noise
44 duckdb:vortex-file-compressed -2.6% -2.8% +0.2% +10.0% ➖ noise
45 datafusion:vortex-compact -5.2% -0.5% -4.7% +11.5% ➖ noise
45 datafusion:vortex-file-compressed -3.2% -0.5% -2.7% +10.0% ➖ noise
45 duckdb:duckdb +1.7% -0.5% +2.2% +10.0% ➖ noise
45 duckdb:vortex-compact +1.5% -0.5% +2.0% +11.6% ➖ noise
45 duckdb:vortex-file-compressed -0.7% -0.5% -0.2% +10.0% ➖ noise
46 datafusion:vortex-compact -0.9% -0.8% -0.0% +11.4% ➖ noise
46 datafusion:vortex-file-compressed -4.3% -0.8% -3.5% +10.0% ➖ noise
46 duckdb:duckdb -1.9% -0.8% -1.1% +10.0% ➖ noise
46 duckdb:vortex-compact +0.2% -0.8% +1.0% +11.0% ➖ noise
46 duckdb:vortex-file-compressed +4.6% -0.8% +5.5% +13.5% ➖ noise
47 datafusion:vortex-compact +0.1% -0.4% +0.5% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -2.2% -0.4% -1.8% +10.0% ➖ noise
47 duckdb:duckdb -2.8% -0.4% -2.4% +10.0% ➖ noise
47 duckdb:vortex-compact -1.5% -0.4% -1.1% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +2.6% -0.4% +3.1% +10.0% ➖ noise
48 datafusion:vortex-compact +3.3% -1.4% +4.7% +21.5% ➖ noise
48 datafusion:vortex-file-compressed +0.8% -1.4% +2.3% +10.0% ➖ noise
48 duckdb:duckdb +1.8% -1.4% +3.2% +10.0% ➖ noise
48 duckdb:vortex-compact -1.2% -1.4% +0.2% +11.2% ➖ noise
48 duckdb:vortex-file-compressed +0.5% -1.4% +1.9% +10.0% ➖ noise
49 datafusion:vortex-compact +2.2% -1.9% +4.2% +10.0% ➖ noise
49 datafusion:vortex-file-compressed +0.5% -1.9% +2.4% +10.0% ➖ noise
49 duckdb:duckdb -1.6% -1.9% +0.3% +10.0% ➖ noise
49 duckdb:vortex-compact +6.3% -1.9% +8.3% +12.6% ➖ noise
49 duckdb:vortex-file-compressed +2.6% -1.9% +4.5% +23.5% ➖ noise
50 datafusion:vortex-compact -1.7% +1.8% -3.5% +10.1% ➖ noise
50 datafusion:vortex-file-compressed -2.5% +1.8% -4.2% +10.0% ➖ noise
50 duckdb:duckdb -0.7% +1.8% -2.5% +10.0% ➖ noise
50 duckdb:vortex-compact -0.0% +1.8% -1.8% +10.0% ➖ noise
50 duckdb:vortex-file-compressed +5.0% +1.8% +3.2% +10.0% ➖ noise
51 datafusion:vortex-compact -1.3% -0.1% -1.2% +10.8% ➖ noise
51 datafusion:vortex-file-compressed -0.2% -0.1% -0.1% +11.6% ➖ noise
51 duckdb:duckdb -2.0% -0.1% -1.9% +11.6% ➖ noise
51 duckdb:vortex-compact +1.0% -0.1% +1.2% +14.0% ➖ noise
51 duckdb:vortex-file-compressed -1.2% -0.1% -1.1% +21.6% ➖ noise
52 datafusion:vortex-compact +2.8% -5.5% +8.8% +23.7% ➖ noise
52 datafusion:vortex-file-compressed -2.5% -5.5% +3.2% +13.8% ➖ noise
52 duckdb:duckdb -22.5% -5.5% -17.9% +18.1% ✅ faster
52 duckdb:vortex-compact -4.8% -5.5% +0.8% +10.0% ➖ noise
52 duckdb:vortex-file-compressed +2.5% -5.5% +8.5% +20.6% ➖ noise
53 datafusion:vortex-compact +1.6% -0.3% +1.9% +10.4% ➖ noise
53 datafusion:vortex-file-compressed +4.2% -0.3% +4.4% +10.4% ➖ noise
53 duckdb:duckdb +0.2% -0.3% +0.4% +10.0% ➖ noise
53 duckdb:vortex-compact +1.9% -0.3% +2.1% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +4.8% -0.3% +5.1% +10.0% ➖ noise
54 datafusion:vortex-compact +0.7% +0.8% -0.1% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -0.2% +0.8% -0.9% +10.0% ➖ noise
54 duckdb:duckdb -0.6% +0.8% -1.4% +10.0% ➖ noise
54 duckdb:vortex-compact +5.7% +0.8% +4.8% +14.0% ➖ noise
54 duckdb:vortex-file-compressed -0.1% +0.8% -0.9% +13.0% ➖ noise
55 datafusion:vortex-compact +0.7% +1.7% -0.9% +10.0% ➖ noise
55 datafusion:vortex-file-compressed -2.8% +1.7% -4.3% +10.0% ➖ noise
55 duckdb:duckdb -2.3% +1.7% -3.9% +14.1% ➖ noise
55 duckdb:vortex-compact -1.1% +1.7% -2.7% +10.0% ➖ noise
55 duckdb:vortex-file-compressed -2.0% +1.7% -3.6% +10.0% ➖ noise
56 datafusion:vortex-compact +5.1% +2.3% +2.8% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -0.2% +2.3% -2.5% +10.0% ➖ noise
56 duckdb:duckdb -1.1% +2.3% -3.3% +10.0% ➖ noise
56 duckdb:vortex-compact +0.5% +2.3% -1.8% +10.0% ➖ noise
56 duckdb:vortex-file-compressed -0.7% +2.3% -2.9% +13.4% ➖ noise
57 datafusion:vortex-compact -0.5% -2.3% +1.9% +10.0% ➖ noise
57 datafusion:vortex-file-compressed +2.3% -2.3% +4.7% +12.5% ➖ noise
57 duckdb:duckdb -1.3% -2.3% +1.1% +10.0% ➖ noise
57 duckdb:vortex-compact -1.5% -2.3% +0.9% +10.9% ➖ noise
57 duckdb:vortex-file-compressed +5.6% -2.3% +8.2% +10.0% ➖ noise
58 datafusion:vortex-compact -2.8% +1.5% -4.2% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -4.7% +1.5% -6.1% +10.0% ➖ noise
58 duckdb:duckdb +2.4% +1.5% +0.9% +14.3% ➖ noise
58 duckdb:vortex-compact +2.4% +1.5% +0.9% +17.1% ➖ noise
58 duckdb:vortex-file-compressed +0.4% +1.5% -1.0% +10.0% ➖ noise
59 datafusion:vortex-compact +0.3% -1.4% +1.7% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -1.6% -1.4% -0.2% +10.0% ➖ noise
59 duckdb:duckdb +0.1% -1.4% +1.5% +10.0% ➖ noise
59 duckdb:vortex-compact +0.2% -1.4% +1.6% +15.4% ➖ noise
59 duckdb:vortex-file-compressed -1.1% -1.4% +0.3% +10.0% ➖ noise
60 datafusion:vortex-compact -1.6% -0.6% -0.9% +10.8% ➖ noise
60 datafusion:vortex-file-compressed -3.6% -0.6% -3.0% +11.1% ➖ noise
60 duckdb:duckdb -4.4% -0.6% -3.7% +10.0% ➖ noise
60 duckdb:vortex-compact -1.4% -0.6% -0.7% +10.0% ➖ noise
60 duckdb:vortex-file-compressed -2.3% -0.6% -1.7% +23.6% ➖ noise
61 datafusion:vortex-compact -4.0% +2.3% -6.2% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +1.7% +2.3% -0.6% +10.0% ➖ noise
61 duckdb:duckdb -6.3% +2.3% -8.4% +10.0% ➖ noise
61 duckdb:vortex-compact -1.9% +2.3% -4.1% +10.0% ➖ noise
61 duckdb:vortex-file-compressed -1.1% +2.3% -3.3% +10.0% ➖ noise
62 datafusion:vortex-compact -13.3% +3.4% -16.1% +27.8% ➖ noise
62 datafusion:vortex-file-compressed -8.1% +3.4% -11.1% +25.1% ➖ noise
62 duckdb:duckdb -0.9% +3.4% -4.1% +15.2% ➖ noise
62 duckdb:vortex-compact +5.1% +3.4% +1.6% +24.7% ➖ noise
62 duckdb:vortex-file-compressed -4.8% +3.4% -8.0% +19.5% ➖ noise
63 datafusion:vortex-compact +3.2% -2.4% +5.8% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -1.2% -2.4% +1.2% +10.0% ➖ noise
63 duckdb:duckdb -5.6% -2.4% -3.2% +10.0% ➖ noise
63 duckdb:vortex-compact +0.3% -2.4% +2.8% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +1.5% -2.4% +4.0% +10.0% ➖ noise
64 datafusion:vortex-compact -1.7% -0.2% -1.6% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -1.2% -0.2% -1.0% +10.0% ➖ noise
64 duckdb:duckdb -1.4% -0.2% -1.3% +10.0% ➖ noise
64 duckdb:vortex-compact +1.5% -0.2% +1.7% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +0.1% -0.2% +0.2% +10.0% ➖ noise
65 datafusion:vortex-compact +8.6% +1.3% +7.1% +15.4% ➖ noise
65 datafusion:vortex-file-compressed +0.4% +1.3% -0.9% +10.0% ➖ noise
65 duckdb:duckdb -1.0% +1.3% -2.3% +10.0% ➖ noise
65 duckdb:vortex-compact +1.3% +1.3% -0.1% +10.0% ➖ noise
65 duckdb:vortex-file-compressed -1.0% +1.3% -2.3% +10.0% ➖ noise
66 datafusion:vortex-compact +0.6% +0.7% -0.2% +13.3% ➖ noise
66 datafusion:vortex-file-compressed +2.5% +0.7% +1.7% +13.0% ➖ noise
66 duckdb:duckdb -2.0% +0.7% -2.7% +10.4% ➖ noise
66 duckdb:vortex-compact -0.8% +0.7% -1.5% +11.6% ➖ noise
66 duckdb:vortex-file-compressed -1.0% +0.7% -1.7% +10.0% ➖ noise
67 datafusion:vortex-compact -1.9% -1.2% -0.8% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -4.9% -1.2% -3.7% +10.0% ➖ noise
67 duckdb:duckdb -0.6% -1.2% +0.5% +10.0% ➖ noise
67 duckdb:vortex-compact -7.7% -1.2% -6.7% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +7.1% -1.2% +8.3% +10.0% ➖ noise
68 datafusion:vortex-compact -2.0% +1.5% -3.4% +10.0% ➖ noise
68 datafusion:vortex-file-compressed +1.5% +1.5% +0.1% +10.0% ➖ noise
68 duckdb:duckdb -3.1% +1.5% -4.5% +10.0% ➖ noise
68 duckdb:vortex-compact +0.5% +1.5% -0.9% +13.4% ➖ noise
68 duckdb:vortex-file-compressed +1.3% +1.5% -0.1% +10.0% ➖ noise
69 datafusion:vortex-compact -1.1% +0.4% -1.4% +10.0% ➖ noise
69 datafusion:vortex-file-compressed +0.1% +0.4% -0.3% +11.0% ➖ noise
69 duckdb:duckdb -4.2% +0.4% -4.6% +10.0% ➖ noise
69 duckdb:vortex-compact +0.6% +0.4% +0.3% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +0.9% +0.4% +0.5% +10.0% ➖ noise
70 datafusion:vortex-compact +2.9% -2.1% +5.2% +12.2% ➖ noise
70 datafusion:vortex-file-compressed -1.4% -2.1% +0.7% +10.0% ➖ noise
70 duckdb:duckdb -5.7% -2.1% -3.6% +11.0% ➖ noise
70 duckdb:vortex-compact +2.3% -2.1% +4.5% +10.0% ➖ noise
70 duckdb:vortex-file-compressed +2.6% -2.1% +4.8% +10.6% ➖ noise
71 datafusion:vortex-compact +1.9% +1.6% +0.3% +10.0% ➖ noise
71 datafusion:vortex-file-compressed +1.4% +1.6% -0.3% +10.0% ➖ noise
71 duckdb:duckdb -3.4% +1.6% -4.9% +11.8% ➖ noise
71 duckdb:vortex-compact -5.7% +1.6% -7.3% +21.2% ➖ noise
71 duckdb:vortex-file-compressed -1.3% +1.6% -2.9% +10.0% ➖ noise
72 datafusion:vortex-compact +0.2% -0.1% +0.3% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +0.6% -0.1% +0.7% +10.0% ➖ noise
72 duckdb:duckdb +1.1% -0.1% +1.3% +10.0% ➖ noise
72 duckdb:vortex-compact +0.2% -0.1% +0.4% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +0.3% -0.1% +0.5% +10.0% ➖ noise
73 datafusion:vortex-compact +0.1% -1.3% +1.4% +19.9% ➖ noise
73 datafusion:vortex-file-compressed +0.4% -1.3% +1.7% +16.3% ➖ noise
73 duckdb:duckdb -4.1% -1.3% -2.8% +12.9% ➖ noise
73 duckdb:vortex-compact -1.7% -1.3% -0.3% +10.0% ➖ noise
73 duckdb:vortex-file-compressed +0.5% -1.3% +1.8% +10.0% ➖ noise
74 datafusion:vortex-compact -2.8% +2.0% -4.7% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +2.4% +2.0% +0.4% +10.0% ➖ noise
74 duckdb:duckdb +0.2% +2.0% -1.7% +10.0% ➖ noise
74 duckdb:vortex-compact +3.4% +2.0% +1.4% +11.1% ➖ noise
74 duckdb:vortex-file-compressed +2.0% +2.0% +0.0% +13.0% ➖ noise
75 datafusion:vortex-compact -0.3% +0.8% -1.1% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +0.8% +0.8% +0.0% +17.0% ➖ noise
75 duckdb:duckdb -1.2% +0.8% -2.0% +10.0% ➖ noise
75 duckdb:vortex-compact +0.4% +0.8% -0.4% +18.2% ➖ noise
75 duckdb:vortex-file-compressed -2.1% +0.8% -2.9% +12.7% ➖ noise
76 datafusion:vortex-compact -0.4% -0.7% +0.2% +10.0% ➖ noise
76 datafusion:vortex-file-compressed -3.0% -0.7% -2.4% +10.0% ➖ noise
76 duckdb:duckdb +0.2% -0.7% +0.8% +10.0% ➖ noise
76 duckdb:vortex-compact -2.1% -0.7% -1.4% +10.0% ➖ noise
76 duckdb:vortex-file-compressed +18.6% -0.7% +19.4% +18.6% 🚨 regression
77 datafusion:vortex-compact -1.3% +0.1% -1.4% +10.0% ➖ noise
77 datafusion:vortex-file-compressed +2.0% +0.1% +1.9% +10.0% ➖ noise
77 duckdb:duckdb -7.4% +0.1% -7.4% +11.2% ➖ noise
77 duckdb:vortex-compact +4.1% +0.1% +4.0% +11.4% ➖ noise
77 duckdb:vortex-file-compressed +3.0% +0.1% +2.9% +10.7% ➖ noise
78 datafusion:vortex-compact -1.8% +0.1% -1.9% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -0.4% +0.1% -0.5% +10.0% ➖ noise
78 duckdb:duckdb -2.3% +0.1% -2.4% +10.0% ➖ noise
78 duckdb:vortex-compact +8.2% +0.1% +8.0% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -4.3% +0.1% -4.4% +10.0% ➖ noise
79 datafusion:vortex-compact -1.1% +0.2% -1.3% +10.0% ➖ noise
79 datafusion:vortex-file-compressed +0.2% +0.2% +0.1% +10.4% ➖ noise
79 duckdb:duckdb -1.6% +0.2% -1.8% +10.0% ➖ noise
79 duckdb:vortex-compact -1.8% +0.2% -2.0% +10.0% ➖ noise
79 duckdb:vortex-file-compressed +2.8% +0.2% +2.6% +10.0% ➖ noise
80 datafusion:vortex-compact -0.5% -3.4% +3.0% +10.0% ➖ noise
80 datafusion:vortex-file-compressed -1.5% -3.4% +2.0% +10.0% ➖ noise
80 duckdb:duckdb -1.1% -3.4% +2.4% +16.2% ➖ noise
80 duckdb:vortex-compact +0.0% -3.4% +3.6% +11.7% ➖ noise
80 duckdb:vortex-file-compressed +6.9% -3.4% +10.7% +14.3% ➖ noise
81 datafusion:vortex-compact -4.9% -0.8% -4.1% +13.0% ➖ noise
81 datafusion:vortex-file-compressed +1.5% -0.8% +2.3% +10.0% ➖ noise
81 duckdb:duckdb -3.1% -0.8% -2.4% +10.0% ➖ noise
81 duckdb:vortex-compact -3.0% -0.8% -2.2% +10.0% ➖ noise
81 duckdb:vortex-file-compressed -0.8% -0.8% -0.0% +10.0% ➖ noise
82 datafusion:vortex-compact +2.9% +1.7% +1.1% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -0.4% +1.7% -2.1% +10.0% ➖ noise
82 duckdb:duckdb +0.1% +1.7% -1.6% +17.4% ➖ noise
82 duckdb:vortex-compact +0.2% +1.7% -1.5% +11.0% ➖ noise
82 duckdb:vortex-file-compressed +1.8% +1.7% +0.1% +10.0% ➖ noise
83 datafusion:vortex-compact -1.4% -2.0% +0.6% +10.0% ➖ noise
83 datafusion:vortex-file-compressed +0.2% -2.0% +2.2% +10.6% ➖ noise
83 duckdb:duckdb -1.0% -2.0% +1.0% +10.0% ➖ noise
83 duckdb:vortex-compact +2.4% -2.0% +4.4% +10.0% ➖ noise
83 duckdb:vortex-file-compressed -6.1% -2.0% -4.2% +10.0% ➖ noise
84 datafusion:vortex-compact +1.0% +0.8% +0.3% +10.0% ➖ noise
84 datafusion:vortex-file-compressed -3.8% +0.8% -4.5% +10.0% ➖ noise
84 duckdb:duckdb -0.5% +0.8% -1.2% +10.0% ➖ noise
84 duckdb:vortex-compact +1.0% +0.8% +0.2% +10.0% ➖ noise
84 duckdb:vortex-file-compressed -3.1% +0.8% -3.9% +10.0% ➖ noise
85 datafusion:vortex-compact +6.8% -0.3% +7.1% +13.4% ➖ noise
85 datafusion:vortex-file-compressed +4.0% -0.3% +4.3% +10.0% ➖ noise
85 duckdb:duckdb +1.7% -0.3% +2.1% +10.0% ➖ noise
85 duckdb:vortex-compact +1.7% -0.3% +2.1% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +0.0% -0.3% +0.3% +10.0% ➖ noise
86 datafusion:vortex-compact +7.4% +7.0% +0.4% +21.3% ➖ noise
86 datafusion:vortex-file-compressed -6.2% +7.0% -12.4% +16.8% ➖ noise
86 duckdb:duckdb -2.6% +7.0% -9.0% +14.9% ➖ noise
86 duckdb:vortex-compact -10.7% +7.0% -16.5% +16.4% ✅ faster
86 duckdb:vortex-file-compressed +9.2% +7.0% +2.0% +18.3% ➖ noise
87 datafusion:vortex-compact -2.3% -0.8% -1.5% +10.3% ➖ noise
87 datafusion:vortex-file-compressed +0.1% -0.8% +0.9% +10.0% ➖ noise
87 duckdb:duckdb +11.5% -0.8% +12.3% +12.0% 🚨 regression
87 duckdb:vortex-compact +1.0% -0.8% +1.8% +10.0% ➖ noise
87 duckdb:vortex-file-compressed -1.9% -0.8% -1.1% +10.0% ➖ noise
88 datafusion:vortex-compact -1.2% +1.7% -2.8% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +0.5% +1.7% -1.1% +10.0% ➖ noise
88 duckdb:duckdb -7.2% +1.7% -8.7% +10.0% ➖ noise
88 duckdb:vortex-compact -3.0% +1.7% -4.6% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +1.8% +1.7% +0.1% +10.0% ➖ noise
89 datafusion:vortex-compact +8.9% +4.8% +3.9% +11.8% ➖ noise
89 datafusion:vortex-file-compressed -0.4% +4.8% -5.0% +12.6% ➖ noise
89 duckdb:duckdb -1.3% +4.8% -5.8% +10.0% ➖ noise
89 duckdb:vortex-compact -2.4% +4.8% -6.8% +10.3% ➖ noise
89 duckdb:vortex-file-compressed +0.3% +4.8% -4.2% +10.0% ➖ noise
90 datafusion:vortex-compact -4.8% -2.0% -2.8% +11.3% ➖ noise
90 datafusion:vortex-file-compressed +6.2% -2.0% +8.4% +10.0% ➖ noise
90 duckdb:duckdb -1.2% -2.0% +0.8% +10.0% ➖ noise
90 duckdb:vortex-compact +1.1% -2.0% +3.2% +13.5% ➖ noise
90 duckdb:vortex-file-compressed -0.9% -2.0% +1.1% +19.8% ➖ noise
91 datafusion:vortex-compact -1.7% +0.4% -2.1% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +0.9% +0.4% +0.5% +10.0% ➖ noise
91 duckdb:duckdb -6.9% +0.4% -7.3% +10.0% ➖ noise
91 duckdb:vortex-compact -2.5% +0.4% -2.9% +12.1% ➖ noise
91 duckdb:vortex-file-compressed -3.4% +0.4% -3.8% +10.0% ➖ noise
92 datafusion:vortex-compact -2.4% +3.1% -5.3% +12.6% ➖ noise
92 datafusion:vortex-file-compressed +1.5% +3.1% -1.6% +12.4% ➖ noise
92 duckdb:duckdb -2.6% +3.1% -5.5% +10.0% ➖ noise
92 duckdb:vortex-compact +5.6% +3.1% +2.4% +19.1% ➖ noise
92 duckdb:vortex-file-compressed +3.7% +3.1% +0.6% +22.4% ➖ noise
93 datafusion:vortex-compact -0.5% +0.6% -1.1% +10.0% ➖ noise
93 datafusion:vortex-file-compressed +1.6% +0.6% +0.9% +10.0% ➖ noise
93 duckdb:duckdb -2.8% +0.6% -3.4% +10.3% ➖ noise
93 duckdb:vortex-compact -1.6% +0.6% -2.2% +10.0% ➖ noise
93 duckdb:vortex-file-compressed -0.5% +0.6% -1.1% +10.0% ➖ noise
94 datafusion:vortex-compact +0.3% +0.7% -0.4% +13.1% ➖ noise
94 datafusion:vortex-file-compressed -4.2% +0.7% -4.9% +10.0% ➖ noise
94 duckdb:duckdb +1.9% +0.7% +1.1% +10.0% ➖ noise
94 duckdb:vortex-compact -1.8% +0.7% -2.5% +10.0% ➖ noise
94 duckdb:vortex-file-compressed -0.2% +0.7% -0.9% +10.0% ➖ noise
95 datafusion:vortex-compact -6.1% -6.8% +0.7% +14.4% ➖ noise
95 datafusion:vortex-file-compressed +1.3% -6.8% +8.6% +12.3% ➖ noise
95 duckdb:duckdb -15.1% -6.8% -8.9% +21.0% ➖ noise
95 duckdb:vortex-compact +3.3% -6.8% +10.8% +16.0% ➖ noise
95 duckdb:vortex-file-compressed -2.1% -6.8% +5.0% +15.8% ➖ noise
96 datafusion:vortex-compact -1.1% +3.1% -4.1% +10.0% ➖ noise
96 datafusion:vortex-file-compressed -0.1% +3.1% -3.1% +10.0% ➖ noise
96 duckdb:duckdb -3.5% +3.1% -6.5% +22.4% ➖ noise
96 duckdb:vortex-compact +1.2% +3.1% -1.9% +39.1% ➖ noise
96 duckdb:vortex-file-compressed +2.0% +3.1% -1.1% +11.0% ➖ noise
97 datafusion:vortex-compact +0.7% -2.3% +3.1% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +3.0% -2.3% +5.5% +10.0% ➖ noise
97 duckdb:duckdb -0.2% -2.3% +2.2% +10.0% ➖ noise
97 duckdb:vortex-compact +2.1% -2.3% +4.5% +11.0% ➖ noise
97 duckdb:vortex-file-compressed -1.4% -2.3% +1.0% +13.4% ➖ noise
98 datafusion:vortex-compact +2.0% -3.7% +5.9% +13.8% ➖ noise
98 datafusion:vortex-file-compressed +1.9% -3.7% +5.8% +12.4% ➖ noise
98 duckdb:duckdb -0.7% -3.7% +3.1% +10.0% ➖ noise
98 duckdb:vortex-compact -0.2% -3.7% +3.6% +10.0% ➖ noise
98 duckdb:vortex-file-compressed -3.2% -3.7% +0.4% +10.0% ➖ noise
99 datafusion:vortex-compact -3.1% -2.1% -1.0% +21.7% ➖ noise
99 datafusion:vortex-file-compressed -12.4% -2.1% -10.5% +15.8% ➖ noise
99 duckdb:duckdb +0.1% -2.1% +2.2% +10.0% ➖ noise
99 duckdb:vortex-compact +0.7% -2.1% +2.8% +19.6% ➖ noise
99 duckdb:vortex-file-compressed +0.6% -2.1% +2.8% +10.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

File Size Changes (48 files changed, -0.0% overall, 0↑ 48↓)
File Scale Format Base HEAD Change %
store_sales.vortex 1.0 vortex-file-compressed 97.04 MB 97.04 MB 32 B -0.0%
store_sales.vortex 1.0 vortex-compact 77.87 MB 77.87 MB 32 B -0.0%
catalog_sales.vortex 1.0 vortex-file-compressed 70.78 MB 70.78 MB 32 B -0.0%
catalog_sales.vortex 1.0 vortex-compact 59.31 MB 59.31 MB 32 B -0.0%
inventory.vortex 1.0 vortex-file-compressed 36.64 MB 36.64 MB 32 B -0.0%
web_sales.vortex 1.0 vortex-file-compressed 34.27 MB 34.27 MB 32 B -0.0%
web_sales.vortex 1.0 vortex-compact 29.35 MB 29.35 MB 32 B -0.0%
inventory.vortex 1.0 vortex-compact 16.07 MB 16.07 MB 32 B -0.0%
store_returns.vortex 1.0 vortex-file-compressed 11.39 MB 11.39 MB 32 B -0.0%
store_returns.vortex 1.0 vortex-compact 9.31 MB 9.31 MB 32 B -0.0%
catalog_returns.vortex 1.0 vortex-file-compressed 7.43 MB 7.43 MB 32 B -0.0%
catalog_returns.vortex 1.0 vortex-compact 6.02 MB 6.02 MB 32 B -0.0%
customer.vortex 1.0 vortex-file-compressed 4.52 MB 4.52 MB 32 B -0.0%
web_returns.vortex 1.0 vortex-file-compressed 3.55 MB 3.55 MB 32 B -0.0%
customer.vortex 1.0 vortex-compact 3.29 MB 3.29 MB 32 B -0.0%
web_returns.vortex 1.0 vortex-compact 2.99 MB 2.99 MB 32 B -0.0%
item.vortex 1.0 vortex-file-compressed 1.75 MB 1.75 MB 32 B -0.0%
customer_demographics.vortex 1.0 vortex-file-compressed 1.49 MB 1.49 MB 32 B -0.0%
date_dim.vortex 1.0 vortex-file-compressed 1.03 MB 1.03 MB 32 B -0.0%
customer_address.vortex 1.0 vortex-file-compressed 1012.96 KB 1012.93 KB 32 B -0.0%
item.vortex 1.0 vortex-compact 994.21 KB 994.18 KB 32 B -0.0%
time_dim.vortex 1.0 vortex-file-compressed 687.30 KB 687.27 KB 32 B -0.0%
customer_demographics.vortex 1.0 vortex-compact 649.61 KB 649.58 KB 32 B -0.0%
catalog_page.vortex 1.0 vortex-file-compressed 611.57 KB 611.54 KB 32 B -0.0%
customer_address.vortex 1.0 vortex-compact 558.62 KB 558.59 KB 32 B -0.0%
catalog_page.vortex 1.0 vortex-compact 362.67 KB 362.64 KB 32 B -0.0%
date_dim.vortex 1.0 vortex-compact 154.00 KB 153.96 KB 32 B -0.0%
time_dim.vortex 1.0 vortex-compact 97.35 KB 97.32 KB 32 B -0.0%
promotion.vortex 1.0 vortex-file-compressed 60.19 KB 60.16 KB 32 B -0.1%
call_center.vortex 1.0 vortex-file-compressed 54.94 KB 54.91 KB 32 B -0.1%
web_site.vortex 1.0 vortex-file-compressed 54.08 KB 54.05 KB 32 B -0.1%
promotion.vortex 1.0 vortex-compact 51.51 KB 51.48 KB 32 B -0.1%
call_center.vortex 1.0 vortex-compact 50.14 KB 50.11 KB 32 B -0.1%
store.vortex 1.0 vortex-file-compressed 49.49 KB 49.46 KB 32 B -0.1%
store.vortex 1.0 vortex-compact 45.76 KB 45.73 KB 32 B -0.1%
web_site.vortex 1.0 vortex-compact 45.31 KB 45.28 KB 32 B -0.1%
web_page.vortex 1.0 vortex-file-compressed 31.92 KB 31.89 KB 32 B -0.1%
web_page.vortex 1.0 vortex-compact 27.84 KB 27.80 KB 32 B -0.1%
warehouse.vortex 1.0 vortex-file-compressed 23.83 KB 23.80 KB 32 B -0.1%
warehouse.vortex 1.0 vortex-compact 22.23 KB 22.20 KB 32 B -0.1%
household_demographics.vortex 1.0 vortex-file-compressed 17.05 KB 17.02 KB 32 B -0.2%
ship_mode.vortex 1.0 vortex-file-compressed 13.12 KB 13.09 KB 32 B -0.2%
ship_mode.vortex 1.0 vortex-compact 10.95 KB 10.92 KB 32 B -0.3%
household_demographics.vortex 1.0 vortex-compact 10.79 KB 10.76 KB 32 B -0.3%
reason.vortex 1.0 vortex-file-compressed 7.23 KB 7.20 KB 32 B -0.4%
income_band.vortex 1.0 vortex-file-compressed 6.19 KB 6.16 KB 32 B -0.5%
income_band.vortex 1.0 vortex-compact 5.98 KB 5.95 KB 32 B -0.5%
reason.vortex 1.0 vortex-compact 5.97 KB 5.94 KB 32 B -0.5%

Totals:

  • vortex-compact: 207.50 MB → 207.50 MB (-0.0%)
  • vortex-file-compressed: 272.70 MB → 272.70 MB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -10.7%
Vortex (geomean): 0.909x ➖
Parquet (geomean): 1.017x ➖
Shifts: Parquet (control) +1.7% · Median polish -4.3%


datafusion / vortex-file-compressed (0.988x ➖, 0↑ 1↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 45829767 55507638 0.83
fineweb_q01/datafusion:vortex-file-compressed 595335317 609592753 0.98
fineweb_q02/datafusion:vortex-file-compressed 🚨 620658641 437398198 1.42
fineweb_q03/datafusion:vortex-file-compressed 1342817562 1514247443 0.89
fineweb_q04/datafusion:vortex-file-compressed 1370287403 1368005491 1.00
fineweb_q05/datafusion:vortex-file-compressed 1363838518 1353996525 1.01
fineweb_q06/datafusion:vortex-file-compressed 1520426771 1822354923 0.83
fineweb_q07/datafusion:vortex-file-compressed 1468044782 1404762920 1.05
fineweb_q08/datafusion:vortex-file-compressed 539762952 537831929 1.00
datafusion / vortex-compact (0.907x ➖, 1↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 41060161 64966002 0.63
fineweb_q01/datafusion:vortex-compact 833955389 800264399 1.04
fineweb_q02/datafusion:vortex-compact 736970929 729106402 1.01
fineweb_q03/datafusion:vortex-compact 1310910374 1538116461 0.85
fineweb_q04/datafusion:vortex-compact 1611940986 1710062563 0.94
fineweb_q05/datafusion:vortex-compact 1372969031 1488884265 0.92
fineweb_q06/datafusion:vortex-compact 1329268990 1375827183 0.97
fineweb_q07/datafusion:vortex-compact 1250247610 1262593936 0.99
fineweb_q08/datafusion:vortex-compact 382302210 433192425 0.88
datafusion / parquet (1.058x ➖, 0↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1279368497 1099591638 1.16
fineweb_q01/datafusion:parquet 1978481104 1888782631 1.05
fineweb_q02/datafusion:parquet 2105697650 1899687977 1.11
fineweb_q03/datafusion:parquet 2088662605 1994807816 1.05
fineweb_q04/datafusion:parquet 2101305003 2160782875 0.97
fineweb_q05/datafusion:parquet 2104103215 1915016514 1.10
fineweb_q06/datafusion:parquet 2198633462 1836765531 1.20
fineweb_q07/datafusion:parquet 1886774813 2069212371 0.91
fineweb_q08/datafusion:parquet 2088551831 2080238315 1.00
duckdb / vortex-file-compressed (0.838x ➖, 1↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 61148797 125501132 0.49
fineweb_q01/duckdb:vortex-file-compressed 641303940 601481985 1.07
fineweb_q02/duckdb:vortex-file-compressed 547442801 607626436 0.90
fineweb_q03/duckdb:vortex-file-compressed 1537688528 1832247149 0.84
fineweb_q04/duckdb:vortex-file-compressed 1645391350 1715400799 0.96
fineweb_q05/duckdb:vortex-file-compressed 1556790168 1786852120 0.87
fineweb_q06/duckdb:vortex-file-compressed 1744370186 2112302337 0.83
fineweb_q07/duckdb:vortex-file-compressed 1424661371 1692213054 0.84
fineweb_q08/duckdb:vortex-file-compressed 627946995 702574910 0.89
duckdb / vortex-compact (0.907x ➖, 1↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 100779126 91873929 1.10
fineweb_q01/duckdb:vortex-compact 579043332 650407386 0.89
fineweb_q02/duckdb:vortex-compact 🚀 630684197 965629785 0.65
fineweb_q03/duckdb:vortex-compact 1698833532 1837971928 0.92
fineweb_q04/duckdb:vortex-compact 1745807373 2005918489 0.87
fineweb_q05/duckdb:vortex-compact 1592706279 1805495731 0.88
fineweb_q06/duckdb:vortex-compact 1674149238 1779222336 0.94
fineweb_q07/duckdb:vortex-compact 1484937447 1541218451 0.96
fineweb_q08/duckdb:vortex-compact 518182390 511320168 1.01
duckdb / parquet (0.978x ➖, 0↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1212976528 1277652806 0.95
fineweb_q01/duckdb:parquet 1497845377 1645543620 0.91
fineweb_q02/duckdb:parquet 1472396357 1450202548 1.02
fineweb_q03/duckdb:parquet 3885594856 3775185501 1.03
fineweb_q04/duckdb:parquet 2096938141 2166499158 0.97
fineweb_q05/duckdb:parquet 2259009367 2359861300 0.96
fineweb_q06/duckdb:parquet 4461979903 4708411648 0.95
fineweb_q07/duckdb:parquet 2835596729 2717177877 1.04
fineweb_q08/duckdb:parquet 1162562043 1172593423 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -36.8% +5.1% -39.9% +236.9% ➖ noise
0 datafusion:vortex-file-compressed -17.4% +5.1% -21.4% +149.3% ➖ noise
0 duckdb:vortex-compact +9.7% +5.1% +4.4% +42.0% ➖ noise
0 duckdb:vortex-file-compressed -51.3% +5.1% -53.6% +109.7% ✅ faster
1 datafusion:vortex-compact +4.2% -2.4% +6.7% +82.2% ➖ noise
1 datafusion:vortex-file-compressed -2.3% -2.4% +0.0% +104.3% ➖ noise
1 duckdb:vortex-compact -11.0% -2.4% -8.8% +39.9% ➖ noise
1 duckdb:vortex-file-compressed +6.6% -2.4% +9.2% +42.7% ➖ noise
2 datafusion:vortex-compact +1.1% +6.1% -4.7% +30.0% ➖ noise
2 datafusion:vortex-file-compressed +41.9% +6.1% +33.8% +30.5% 🚨 regression
2 duckdb:vortex-compact -34.7% +6.1% -38.4% +32.9% ✅ faster
2 duckdb:vortex-file-compressed -9.9% +6.1% -15.1% +30.0% ➖ noise
3 datafusion:vortex-compact -14.8% +3.8% -17.9% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -11.3% +3.8% -14.6% +30.0% ➖ noise
3 duckdb:vortex-compact -7.6% +3.8% -11.0% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -16.1% +3.8% -19.2% +30.0% ➖ noise
4 datafusion:vortex-compact -5.7% -3.0% -2.8% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +0.2% -3.0% +3.2% +30.0% ➖ noise
4 duckdb:vortex-compact -13.0% -3.0% -10.3% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -4.1% -3.0% -1.1% +42.0% ➖ noise
5 datafusion:vortex-compact -7.8% +2.6% -10.1% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +0.7% +2.6% -1.8% +30.0% ➖ noise
5 duckdb:vortex-compact -11.8% +2.6% -14.0% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -12.9% +2.6% -15.0% +30.0% ➖ noise
6 datafusion:vortex-compact -3.4% +6.5% -9.3% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -16.6% +6.5% -21.7% +30.0% ➖ noise
6 duckdb:vortex-compact -5.9% +6.5% -11.7% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -17.4% +6.5% -22.5% +30.0% ➖ noise
7 datafusion:vortex-compact -1.0% -2.5% +1.5% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +4.5% -2.5% +7.1% +30.0% ➖ noise
7 duckdb:vortex-compact -3.7% -2.5% -1.2% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -15.8% -2.5% -13.7% +30.0% ➖ noise
8 datafusion:vortex-compact -11.7% -0.2% -11.5% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +0.4% -0.2% +0.6% +38.1% ➖ noise
8 duckdb:vortex-compact +1.3% -0.2% +1.6% +39.3% ➖ noise
8 duckdb:vortex-file-compressed -10.6% -0.2% -10.4% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.4%
Vortex (geomean): 0.968x ➖
Parquet (geomean): 0.953x ➖
Shifts: Parquet (control) -4.7% · Median polish -0.5%


datafusion / vortex-file-compressed (0.935x ➖, 7↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 393751476 395359594 1.00
tpch_q02/datafusion:vortex-file-compressed 106318905 105447735 1.01
tpch_q03/datafusion:vortex-file-compressed 214672535 214364958 1.00
tpch_q04/datafusion:vortex-file-compressed 111803744 112313830 1.00
tpch_q05/datafusion:vortex-file-compressed 367223072 366448144 1.00
tpch_q06/datafusion:vortex-file-compressed 36484215 36651536 1.00
tpch_q07/datafusion:vortex-file-compressed 502007085 495713046 1.01
tpch_q08/datafusion:vortex-file-compressed 358394833 349321366 1.03
tpch_q09/datafusion:vortex-file-compressed 🚀 632366952 762090647 0.83
tpch_q10/datafusion:vortex-file-compressed 🚀 225872824 292119784 0.77
tpch_q11/datafusion:vortex-file-compressed 🚀 81288113 103438313 0.79
tpch_q12/datafusion:vortex-file-compressed 🚀 116687289 148316051 0.79
tpch_q13/datafusion:vortex-file-compressed 🚀 214037558 254553033 0.84
tpch_q14/datafusion:vortex-file-compressed 53482304 52674729 1.02
tpch_q15/datafusion:vortex-file-compressed 98826678 97453848 1.01
tpch_q16/datafusion:vortex-file-compressed 🚀 75876268 91175972 0.83
tpch_q17/datafusion:vortex-file-compressed 🚀 629278972 828570100 0.76
tpch_q18/datafusion:vortex-file-compressed 824012812 833948783 0.99
tpch_q19/datafusion:vortex-file-compressed 70315551 69275502 1.02
tpch_q20/datafusion:vortex-file-compressed 160178072 159598836 1.00
tpch_q21/datafusion:vortex-file-compressed 658361995 642907223 1.02
tpch_q22/datafusion:vortex-file-compressed 63063417 64748427 0.97
datafusion / vortex-compact (0.971x ➖, 5↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 434576063 428296854 1.01
tpch_q02/datafusion:vortex-compact 110100406 107122983 1.03
tpch_q03/datafusion:vortex-compact 214143989 212291201 1.01
tpch_q04/datafusion:vortex-compact 120267825 116830312 1.03
tpch_q05/datafusion:vortex-compact 373186906 369326262 1.01
tpch_q06/datafusion:vortex-compact 57688390 58435269 0.99
tpch_q07/datafusion:vortex-compact 519280963 507583632 1.02
tpch_q08/datafusion:vortex-compact 356763921 351772981 1.01
tpch_q09/datafusion:vortex-compact 634058497 635734149 1.00
tpch_q10/datafusion:vortex-compact 241808037 240560475 1.01
tpch_q11/datafusion:vortex-compact 82987558 81823491 1.01
tpch_q12/datafusion:vortex-compact 157665854 156565771 1.01
tpch_q13/datafusion:vortex-compact 265891788 262807032 1.01
tpch_q14/datafusion:vortex-compact 69773060 68427035 1.02
tpch_q15/datafusion:vortex-compact 152698245 152972222 1.00
tpch_q16/datafusion:vortex-compact 80978391 76779231 1.05
tpch_q17/datafusion:vortex-compact 637212994 628215543 1.01
tpch_q18/datafusion:vortex-compact 🚀 843611015 992555460 0.85
tpch_q19/datafusion:vortex-compact 🚀 121501313 141285855 0.86
tpch_q20/datafusion:vortex-compact 🚀 181767973 235060019 0.77
tpch_q21/datafusion:vortex-compact 🚀 651068688 754047427 0.86
tpch_q22/datafusion:vortex-compact 🚀 72557874 84870103 0.85
datafusion / parquet (0.948x ➖, 7↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 442582051 492912748 0.90
tpch_q02/datafusion:parquet 🚀 169253145 198265460 0.85
tpch_q03/datafusion:parquet 🚀 280105013 345508700 0.81
tpch_q04/datafusion:parquet 🚀 125803659 151247020 0.83
tpch_q05/datafusion:parquet 🚀 426592669 547086218 0.78
tpch_q06/datafusion:parquet 🚀 118804899 140969317 0.84
tpch_q07/datafusion:parquet 🚀 606811273 761356334 0.80
tpch_q08/datafusion:parquet 460728480 449621268 1.02
tpch_q09/datafusion:parquet 736205139 733202651 1.00
tpch_q10/datafusion:parquet 488251968 499994481 0.98
tpch_q11/datafusion:parquet 113790425 115593530 0.98
tpch_q12/datafusion:parquet 204766313 190304051 1.08
tpch_q13/datafusion:parquet 332778102 332001062 1.00
tpch_q14/datafusion:parquet 157966205 154597678 1.02
tpch_q15/datafusion:parquet 245759415 238242304 1.03
tpch_q16/datafusion:parquet 119647010 118781743 1.01
tpch_q17/datafusion:parquet 677971560 678441522 1.00
tpch_q18/datafusion:parquet 869874899 864535205 1.01
tpch_q19/datafusion:parquet 257850777 254744062 1.01
tpch_q20/datafusion:parquet 286947379 287545716 1.00
tpch_q21/datafusion:parquet 688379585 688104696 1.00
tpch_q22/datafusion:parquet 212242832 214008360 0.99
datafusion / arrow (0.988x ➖, 3↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 592191549 588251376 1.01
tpch_q02/datafusion:arrow 161093450 160274751 1.01
tpch_q03/datafusion:arrow 467235988 450181445 1.04
tpch_q04/datafusion:arrow 342466556 346802207 0.99
tpch_q05/datafusion:arrow 929462560 924703967 1.01
tpch_q06/datafusion:arrow 281736675 272796432 1.03
tpch_q07/datafusion:arrow 1149083185 1117217281 1.03
tpch_q08/datafusion:arrow 🚀 1134817274 1411887218 0.80
tpch_q09/datafusion:arrow 1341972648 1333142818 1.01
tpch_q10/datafusion:arrow 586084793 576326446 1.02
tpch_q11/datafusion:arrow 138536506 138239254 1.00
tpch_q12/datafusion:arrow 🚀 688062128 786287803 0.88
tpch_q13/datafusion:arrow 496441417 500722129 0.99
tpch_q14/datafusion:arrow 322144021 301473366 1.07
tpch_q15/datafusion:arrow 700424396 668672736 1.05
tpch_q16/datafusion:arrow 103833539 102469545 1.01
tpch_q17/datafusion:arrow 🚀 1331111547 1646855062 0.81
tpch_q18/datafusion:arrow 1893689541 1932327827 0.98
tpch_q19/datafusion:arrow 481708036 476337195 1.01
tpch_q20/datafusion:arrow 515285105 483655055 1.07
tpch_q21/datafusion:arrow 3023471228 2958821315 1.02
tpch_q22/datafusion:arrow 130516909 132198019 0.99
duckdb / vortex-file-compressed (0.996x ➖, 0↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 172122682 174714617 0.99
tpch_q02/duckdb:vortex-file-compressed 52574081 53849779 0.98
tpch_q03/duckdb:vortex-file-compressed 125516528 130109980 0.96
tpch_q04/duckdb:vortex-file-compressed 160083029 164755736 0.97
tpch_q05/duckdb:vortex-file-compressed 138756259 143094093 0.97
tpch_q06/duckdb:vortex-file-compressed 33890024 35892452 0.94
tpch_q07/duckdb:vortex-file-compressed 138142666 137079209 1.01
tpch_q08/duckdb:vortex-file-compressed 172993075 176766184 0.98
tpch_q09/duckdb:vortex-file-compressed 390489939 401406416 0.97
tpch_q10/duckdb:vortex-file-compressed 189487260 192959709 0.98
tpch_q11/duckdb:vortex-file-compressed 32735751 33014409 0.99
tpch_q12/duckdb:vortex-file-compressed 100577699 100250362 1.00
tpch_q13/duckdb:vortex-file-compressed 230476749 231150051 1.00
tpch_q14/duckdb:vortex-file-compressed 56516542 55278444 1.02
tpch_q15/duckdb:vortex-file-compressed 91428927 89477901 1.02
tpch_q16/duckdb:vortex-file-compressed 78241419 77323405 1.01
tpch_q17/duckdb:vortex-file-compressed 97703743 94666785 1.03
tpch_q18/duckdb:vortex-file-compressed 286548359 282623100 1.01
tpch_q19/duckdb:vortex-file-compressed 79814175 77208763 1.03
tpch_q20/duckdb:vortex-file-compressed 153117987 150749990 1.02
tpch_q21/duckdb:vortex-file-compressed 492072282 484964849 1.01
tpch_q22/duckdb:vortex-file-compressed 65147353 64064096 1.02
duckdb / vortex-compact (0.971x ➖, 4↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 226922530 228877733 0.99
tpch_q02/duckdb:vortex-compact 58221795 57366602 1.01
tpch_q03/duckdb:vortex-compact 139939129 137181575 1.02
tpch_q04/duckdb:vortex-compact 175060623 171373088 1.02
tpch_q05/duckdb:vortex-compact 166577092 163783776 1.02
tpch_q06/duckdb:vortex-compact 60346245 57382918 1.05
tpch_q07/duckdb:vortex-compact 173264694 172263276 1.01
tpch_q08/duckdb:vortex-compact 187399607 187570707 1.00
tpch_q09/duckdb:vortex-compact 425524978 426392607 1.00
tpch_q10/duckdb:vortex-compact 218593692 219589617 1.00
tpch_q11/duckdb:vortex-compact 38436299 38291845 1.00
tpch_q12/duckdb:vortex-compact 161571108 163800493 0.99
tpch_q13/duckdb:vortex-compact 276472808 276249785 1.00
tpch_q14/duckdb:vortex-compact 73218093 71590826 1.02
tpch_q15/duckdb:vortex-compact 114527206 117030767 0.98
tpch_q16/duckdb:vortex-compact 80134949 81732489 0.98
tpch_q17/duckdb:vortex-compact 108828172 110629572 0.98
tpch_q18/duckdb:vortex-compact 🚀 287461603 335331878 0.86
tpch_q19/duckdb:vortex-compact 🚀 96281075 110086645 0.87
tpch_q20/duckdb:vortex-compact 🚀 183289513 223783508 0.82
tpch_q21/duckdb:vortex-compact 🚀 513659967 615749019 0.83
tpch_q22/duckdb:vortex-compact 72789691 76427156 0.95
duckdb / parquet (0.957x ➖, 3↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 261201507 264113005 0.99
tpch_q02/duckdb:parquet 99910277 104732147 0.95
tpch_q03/duckdb:parquet 211995085 208461597 1.02
tpch_q04/duckdb:parquet 133269007 134299709 0.99
tpch_q05/duckdb:parquet 222573609 224114928 0.99
tpch_q06/duckdb:parquet 74856060 72778296 1.03
tpch_q07/duckdb:parquet 188238123 186813825 1.01
tpch_q08/duckdb:parquet 264805155 264994033 1.00
tpch_q09/duckdb:parquet 478845607 463884421 1.03
tpch_q10/duckdb:parquet 621447998 626265290 0.99
tpch_q11/duckdb:parquet 🚀 61616370 71841208 0.86
tpch_q12/duckdb:parquet 131256986 143576070 0.91
tpch_q13/duckdb:parquet 454778397 486418446 0.93
tpch_q14/duckdb:parquet 179217898 187746032 0.95
tpch_q15/duckdb:parquet 104924305 108697480 0.97
tpch_q16/duckdb:parquet 165196154 182221904 0.91
tpch_q17/duckdb:parquet 182319257 198079056 0.92
tpch_q18/duckdb:parquet 🚀 364792643 417573549 0.87
tpch_q19/duckdb:parquet 🚀 281571716 317494872 0.89
tpch_q20/duckdb:parquet 223741713 245893211 0.91
tpch_q21/duckdb:parquet 558909372 587158716 0.95
tpch_q22/duckdb:parquet 295460552 293073102 1.01
duckdb / duckdb (0.992x ➖, 0↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 119554405 122624597 0.97
tpch_q02/duckdb:duckdb 53054567 50516265 1.05
tpch_q03/duckdb:duckdb 103884958 107049061 0.97
tpch_q04/duckdb:duckdb 138743882 146899394 0.94
tpch_q05/duckdb:duckdb 119381869 123658667 0.97
tpch_q06/duckdb:duckdb 44981810 45223167 0.99
tpch_q07/duckdb:duckdb 91113993 92815372 0.98
tpch_q08/duckdb:duckdb 119002798 121137242 0.98
tpch_q09/duckdb:duckdb 281138817 285197650 0.99
tpch_q10/duckdb:duckdb 212265613 218010856 0.97
tpch_q11/duckdb:duckdb 19555161 19693655 0.99
tpch_q12/duckdb:duckdb 91149478 91535497 1.00
tpch_q13/duckdb:duckdb 228424565 231377143 0.99
tpch_q14/duckdb:duckdb 78175478 78725998 0.99
tpch_q15/duckdb:duckdb 82164116 81036722 1.01
tpch_q16/duckdb:duckdb 75748413 76616195 0.99
tpch_q17/duckdb:duckdb 88175619 87971162 1.00
tpch_q18/duckdb:duckdb 233842950 232269771 1.01
tpch_q19/duckdb:duckdb 123924115 123568750 1.00
tpch_q20/duckdb:duckdb 118048817 117973540 1.00
tpch_q21/duckdb:duckdb 302067010 301162188 1.00
tpch_q22/duckdb:duckdb 71052279 70355189 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +0.7% -5.8% +6.8% +11.4% ➖ noise
1 datafusion:vortex-compact +1.5% -5.8% +7.7% +11.4% ➖ noise
1 datafusion:vortex-file-compressed -0.4% -5.8% +5.7% +11.4% ➖ noise
1 duckdb:duckdb -2.5% -5.8% +3.5% +11.4% ➖ noise
1 duckdb:vortex-compact -0.9% -5.8% +5.2% +11.4% ➖ noise
1 duckdb:vortex-file-compressed -1.5% -5.8% +4.5% +11.4% ➖ noise
2 datafusion:arrow +0.5% -9.8% +11.4% +11.4% ➖ noise
2 datafusion:vortex-compact +2.8% -9.8% +13.9% +11.4% 🚨 regression
2 datafusion:vortex-file-compressed +0.8% -9.8% +11.7% +11.4% 🚨 regression
2 duckdb:duckdb +5.0% -9.8% +16.4% +11.4% 🚨 regression
2 duckdb:vortex-compact +1.5% -9.8% +12.5% +11.4% 🚨 regression
2 duckdb:vortex-file-compressed -2.4% -9.8% +8.2% +11.4% ➖ noise
3 datafusion:arrow +3.8% -9.2% +14.3% +11.4% 🚨 regression
3 datafusion:vortex-compact +0.9% -9.2% +11.1% +11.4% ➖ noise
3 datafusion:vortex-file-compressed +0.1% -9.2% +10.3% +11.4% ➖ noise
3 duckdb:duckdb -3.0% -9.2% +6.9% +11.4% ➖ noise
3 duckdb:vortex-compact +2.0% -9.2% +12.3% +11.4% 🚨 regression
3 duckdb:vortex-file-compressed -3.5% -9.2% +6.2% +11.4% ➖ noise
4 datafusion:arrow -1.3% -9.1% +8.7% +11.4% ➖ noise
4 datafusion:vortex-compact +2.9% -9.1% +13.3% +11.4% 🚨 regression
4 datafusion:vortex-file-compressed -0.5% -9.1% +9.6% +11.4% ➖ noise
4 duckdb:duckdb -5.6% -9.1% +4.0% +11.4% ➖ noise
4 duckdb:vortex-compact +2.2% -9.1% +12.4% +11.4% 🚨 regression
4 duckdb:vortex-file-compressed -2.8% -9.1% +6.9% +11.4% ➖ noise
5 datafusion:arrow +0.5% -12.0% +14.2% +11.4% 🚨 regression
5 datafusion:vortex-compact +1.0% -12.0% +14.8% +11.4% 🚨 regression
5 datafusion:vortex-file-compressed +0.2% -12.0% +13.9% +11.4% 🚨 regression
5 duckdb:duckdb -3.5% -12.0% +9.7% +11.4% ➖ noise
5 duckdb:vortex-compact +1.7% -12.0% +15.6% +11.4% 🚨 regression
5 duckdb:vortex-file-compressed -3.0% -12.0% +10.2% +11.4% ➖ noise
6 datafusion:arrow +3.3% -6.9% +10.9% +11.4% ➖ noise
6 datafusion:vortex-compact -1.3% -6.9% +6.0% +11.4% ➖ noise
6 datafusion:vortex-file-compressed -0.5% -6.9% +6.9% +11.4% ➖ noise
6 duckdb:duckdb -0.5% -6.9% +6.8% +11.4% ➖ noise
6 duckdb:vortex-compact +5.2% -6.9% +13.0% +11.4% 🚨 regression
6 duckdb:vortex-file-compressed -5.6% -6.9% +1.4% +11.4% ➖ noise
7 datafusion:arrow +2.9% -10.4% +14.8% +11.4% 🚨 regression
7 datafusion:vortex-compact +2.3% -10.4% +14.2% +11.4% 🚨 regression
7 datafusion:vortex-file-compressed +1.3% -10.4% +13.0% +11.4% 🚨 regression
7 duckdb:duckdb -1.8% -10.4% +9.5% +11.4% ➖ noise
7 duckdb:vortex-compact +0.6% -10.4% +12.2% +11.4% 🚨 regression
7 duckdb:vortex-file-compressed +0.8% -10.4% +12.5% +11.4% 🚨 regression
8 datafusion:arrow -19.6% +1.2% -20.6% +11.4% ✅ faster
8 datafusion:vortex-compact +1.4% +1.2% +0.2% +11.4% ➖ noise
8 datafusion:vortex-file-compressed +2.6% +1.2% +1.4% +11.4% ➖ noise
8 duckdb:duckdb -1.8% +1.2% -2.9% +11.4% ➖ noise
8 duckdb:vortex-compact -0.1% +1.2% -1.3% +11.4% ➖ noise
8 duckdb:vortex-file-compressed -2.1% +1.2% -3.3% +11.4% ➖ noise
9 datafusion:arrow +0.7% +1.8% -1.1% +11.4% ➖ noise
9 datafusion:vortex-compact -0.3% +1.8% -2.0% +11.4% ➖ noise
9 datafusion:vortex-file-compressed -17.0% +1.8% -18.5% +11.4% ✅ faster
9 duckdb:duckdb -1.4% +1.8% -3.2% +11.4% ➖ noise
9 duckdb:vortex-compact -0.2% +1.8% -2.0% +11.4% ➖ noise
9 duckdb:vortex-file-compressed -2.7% +1.8% -4.4% +11.4% ➖ noise
10 datafusion:arrow +1.7% -1.6% +3.3% +11.4% ➖ noise
10 datafusion:vortex-compact +0.5% -1.6% +2.1% +11.4% ➖ noise
10 datafusion:vortex-file-compressed -22.7% -1.6% -21.5% +11.4% ✅ faster
10 duckdb:duckdb -2.6% -1.6% -1.1% +11.4% ➖ noise
10 duckdb:vortex-compact -0.5% -1.6% +1.1% +11.4% ➖ noise
10 duckdb:vortex-file-compressed -1.8% -1.6% -0.2% +11.4% ➖ noise
11 datafusion:arrow +0.2% -8.1% +9.1% +11.4% ➖ noise
11 datafusion:vortex-compact +1.4% -8.1% +10.4% +11.4% ➖ noise
11 datafusion:vortex-file-compressed -21.4% -8.1% -14.5% +11.4% ✅ faster
11 duckdb:duckdb -0.7% -8.1% +8.1% +11.4% ➖ noise
11 duckdb:vortex-compact +0.4% -8.1% +9.2% +11.4% ➖ noise
11 duckdb:vortex-file-compressed -0.8% -8.1% +7.9% +11.4% ➖ noise
12 datafusion:arrow -12.5% -0.8% -11.8% +35.9% ➖ noise
12 datafusion:vortex-compact +0.7% -0.8% +1.5% +11.4% ➖ noise
12 datafusion:vortex-file-compressed -21.3% -0.8% -20.7% +11.4% ✅ faster
12 duckdb:duckdb -0.4% -0.8% +0.4% +11.4% ➖ noise
12 duckdb:vortex-compact -1.4% -0.8% -0.5% +11.4% ➖ noise
12 duckdb:vortex-file-compressed +0.3% -0.8% +1.2% +11.4% ➖ noise
13 datafusion:arrow -0.9% -3.2% +2.4% +11.4% ➖ noise
13 datafusion:vortex-compact +1.2% -3.2% +4.5% +11.4% ➖ noise
13 datafusion:vortex-file-compressed -15.9% -3.2% -13.1% +11.4% ✅ faster
13 duckdb:duckdb -1.3% -3.2% +2.0% +11.4% ➖ noise
13 duckdb:vortex-compact +0.1% -3.2% +3.4% +11.4% ➖ noise
13 duckdb:vortex-file-compressed -0.3% -3.2% +3.0% +11.4% ➖ noise
14 datafusion:arrow +6.9% -1.2% +8.2% +11.4% ➖ noise
14 datafusion:vortex-compact +2.0% -1.2% +3.2% +11.4% ➖ noise
14 datafusion:vortex-file-compressed +1.5% -1.2% +2.8% +11.4% ➖ noise
14 duckdb:duckdb -0.7% -1.2% +0.5% +11.4% ➖ noise
14 duckdb:vortex-compact +2.3% -1.2% +3.6% +11.4% ➖ noise
14 duckdb:vortex-file-compressed +2.2% -1.2% +3.5% +11.4% ➖ noise
15 datafusion:arrow +4.7% -0.2% +5.0% +11.4% ➖ noise
15 datafusion:vortex-compact -0.2% -0.2% +0.0% +11.4% ➖ noise
15 datafusion:vortex-file-compressed +1.4% -0.2% +1.6% +11.4% ➖ noise
15 duckdb:duckdb +1.4% -0.2% +1.6% +11.4% ➖ noise
15 duckdb:vortex-compact -2.1% -0.2% -1.9% +11.4% ➖ noise
15 duckdb:vortex-file-compressed +2.2% -0.2% +2.4% +11.4% ➖ noise
16 datafusion:arrow +1.3% -4.4% +6.0% +11.4% ➖ noise
16 datafusion:vortex-compact +5.5% -4.4% +10.4% +11.4% ➖ noise
16 datafusion:vortex-file-compressed -16.8% -4.4% -12.9% +12.3% ✅ faster
16 duckdb:duckdb -1.1% -4.4% +3.5% +11.4% ➖ noise
16 duckdb:vortex-compact -2.0% -4.4% +2.6% +11.4% ➖ noise
16 duckdb:vortex-file-compressed +1.2% -4.4% +5.9% +11.4% ➖ noise
17 datafusion:arrow -19.2% -4.1% -15.7% +11.4% ✅ faster
17 datafusion:vortex-compact +1.4% -4.1% +5.8% +11.4% ➖ noise
17 datafusion:vortex-file-compressed -24.1% -4.1% -20.8% +11.4% ✅ faster
17 duckdb:duckdb +0.2% -4.1% +4.5% +11.4% ➖ noise
17 duckdb:vortex-compact -1.6% -4.1% +2.6% +11.4% ➖ noise
17 duckdb:vortex-file-compressed +3.2% -4.1% +7.6% +11.4% ➖ noise
18 datafusion:arrow -2.0% -6.2% +4.5% +11.4% ➖ noise
18 datafusion:vortex-compact -15.0% -6.2% -9.3% +11.4% ➖ noise
18 datafusion:vortex-file-compressed -1.2% -6.2% +5.4% +11.4% ➖ noise
18 duckdb:duckdb +0.7% -6.2% +7.4% +11.4% ➖ noise
18 duckdb:vortex-compact -14.3% -6.2% -8.6% +11.4% ➖ noise
18 duckdb:vortex-file-compressed +1.4% -6.2% +8.1% +11.4% ➖ noise
19 datafusion:arrow +1.1% -5.3% +6.7% +11.4% ➖ noise
19 datafusion:vortex-compact -14.0% -5.3% -9.2% +11.4% ➖ noise
19 datafusion:vortex-file-compressed +1.5% -5.3% +7.1% +11.4% ➖ noise
19 duckdb:duckdb +0.3% -5.3% +5.8% +11.4% ➖ noise
19 duckdb:vortex-compact -12.5% -5.3% -7.7% +11.4% ➖ noise
19 duckdb:vortex-file-compressed +3.4% -5.3% +9.1% +11.4% ➖ noise
20 datafusion:arrow +6.5% -4.7% +11.8% +11.4% 🚨 regression
20 datafusion:vortex-compact -22.7% -4.7% -18.8% +11.4% ✅ faster
20 datafusion:vortex-file-compressed +0.4% -4.7% +5.3% +11.4% ➖ noise
20 duckdb:duckdb +0.1% -4.7% +5.0% +11.4% ➖ noise
20 duckdb:vortex-compact -18.1% -4.7% -14.0% +11.4% ✅ faster
20 duckdb:vortex-file-compressed +1.6% -4.7% +6.6% +11.4% ➖ noise
21 datafusion:arrow +2.2% -2.4% +4.7% +11.4% ➖ noise
21 datafusion:vortex-compact -13.7% -2.4% -11.5% +11.9% ✅ faster
21 datafusion:vortex-file-compressed +2.4% -2.4% +4.9% +11.4% ➖ noise
21 duckdb:duckdb +0.3% -2.4% +2.8% +11.4% ➖ noise
21 duckdb:vortex-compact -16.6% -2.4% -14.5% +11.4% ✅ faster
21 duckdb:vortex-file-compressed +1.5% -2.4% +4.0% +11.4% ➖ noise
22 datafusion:arrow -1.3% -0.0% -1.3% +11.4% ➖ noise
22 datafusion:vortex-compact -14.5% -0.0% -14.5% +11.4% ✅ faster
22 datafusion:vortex-file-compressed -2.6% -0.0% -2.6% +11.4% ➖ noise
22 duckdb:duckdb +1.0% -0.0% +1.0% +11.4% ➖ noise
22 duckdb:vortex-compact -4.8% -0.0% -4.8% +11.4% ➖ noise
22 duckdb:vortex-file-compressed +1.7% -0.0% +1.7% +11.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

File Size Changes (48 files changed, -0.0% overall, 0↑ 48↓)
File Scale Format Base HEAD Change %
partsupp_1.vortex 10.0 vortex-file-compressed 180.65 MB 180.65 MB 32 B -0.0%
partsupp_0.vortex 10.0 vortex-file-compressed 180.47 MB 180.47 MB 32 B -0.0%
orders_1.vortex 10.0 vortex-file-compressed 164.15 MB 164.15 MB 32 B -0.0%
orders_2.vortex 10.0 vortex-file-compressed 164.00 MB 164.00 MB 32 B -0.0%
orders_0.vortex 10.0 vortex-file-compressed 163.92 MB 163.92 MB 32 B -0.0%
lineitem_11.vortex 10.0 vortex-file-compressed 134.87 MB 134.87 MB 32 B -0.0%
lineitem_0.vortex 10.0 vortex-file-compressed 134.65 MB 134.65 MB 32 B -0.0%
lineitem_9.vortex 10.0 vortex-file-compressed 134.65 MB 134.65 MB 32 B -0.0%
lineitem_12.vortex 10.0 vortex-file-compressed 134.52 MB 134.52 MB 32 B -0.0%
lineitem_10.vortex 10.0 vortex-file-compressed 134.51 MB 134.51 MB 32 B -0.0%
lineitem_4.vortex 10.0 vortex-file-compressed 134.43 MB 134.43 MB 32 B -0.0%
lineitem_2.vortex 10.0 vortex-file-compressed 134.38 MB 134.38 MB 32 B -0.0%
lineitem_1.vortex 10.0 vortex-file-compressed 134.27 MB 134.27 MB 32 B -0.0%
lineitem_8.vortex 10.0 vortex-file-compressed 134.06 MB 134.06 MB 32 B -0.0%
lineitem_7.vortex 10.0 vortex-file-compressed 134.01 MB 134.01 MB 32 B -0.0%
lineitem_5.vortex 10.0 vortex-file-compressed 133.86 MB 133.86 MB 32 B -0.0%
lineitem_3.vortex 10.0 vortex-file-compressed 133.74 MB 133.74 MB 32 B -0.0%
lineitem_6.vortex 10.0 vortex-file-compressed 133.23 MB 133.23 MB 32 B -0.0%
partsupp_0.vortex 10.0 vortex-compact 126.76 MB 126.76 MB 32 B -0.0%
partsupp_1.vortex 10.0 vortex-compact 126.74 MB 126.74 MB 32 B -0.0%
orders_0.vortex 10.0 vortex-compact 114.79 MB 114.79 MB 32 B -0.0%
orders_2.vortex 10.0 vortex-compact 114.78 MB 114.78 MB 32 B -0.0%
orders_1.vortex 10.0 vortex-compact 114.76 MB 114.76 MB 32 B -0.0%
customer_0.vortex 10.0 vortex-file-compressed 104.73 MB 104.73 MB 32 B -0.0%
lineitem_5.vortex 10.0 vortex-compact 100.70 MB 100.70 MB 32 B -0.0%
lineitem_6.vortex 10.0 vortex-compact 100.68 MB 100.68 MB 32 B -0.0%
lineitem_1.vortex 10.0 vortex-compact 100.64 MB 100.64 MB 32 B -0.0%
lineitem_12.vortex 10.0 vortex-compact 100.62 MB 100.62 MB 32 B -0.0%
lineitem_10.vortex 10.0 vortex-compact 100.62 MB 100.62 MB 32 B -0.0%
lineitem_3.vortex 10.0 vortex-compact 100.62 MB 100.62 MB 32 B -0.0%
lineitem_0.vortex 10.0 vortex-compact 100.59 MB 100.59 MB 32 B -0.0%
lineitem_8.vortex 10.0 vortex-compact 100.59 MB 100.59 MB 32 B -0.0%
lineitem_2.vortex 10.0 vortex-compact 100.59 MB 100.59 MB 32 B -0.0%
lineitem_7.vortex 10.0 vortex-compact 100.58 MB 100.58 MB 32 B -0.0%
lineitem_4.vortex 10.0 vortex-compact 100.56 MB 100.56 MB 32 B -0.0%
lineitem_11.vortex 10.0 vortex-compact 100.53 MB 100.53 MB 32 B -0.0%
lineitem_9.vortex 10.0 vortex-compact 100.46 MB 100.46 MB 32 B -0.0%
customer_0.vortex 10.0 vortex-compact 74.12 MB 74.12 MB 32 B -0.0%
part_0.vortex 10.0 vortex-file-compressed 27.02 MB 27.02 MB 32 B -0.0%
part_1.vortex 10.0 vortex-file-compressed 26.99 MB 26.99 MB 32 B -0.0%
part_1.vortex 10.0 vortex-compact 18.11 MB 18.11 MB 32 B -0.0%
part_0.vortex 10.0 vortex-compact 18.11 MB 18.11 MB 32 B -0.0%
supplier_0.vortex 10.0 vortex-file-compressed 6.69 MB 6.69 MB 32 B -0.0%
supplier_0.vortex 10.0 vortex-compact 4.73 MB 4.73 MB 32 B -0.0%
nation_0.vortex 10.0 vortex-file-compressed 11.00 KB 10.97 KB 32 B -0.3%
nation_0.vortex 10.0 vortex-compact 8.34 KB 8.31 KB 32 B -0.4%
region_0.vortex 10.0 vortex-file-compressed 6.16 KB 6.13 KB 32 B -0.5%
region_0.vortex 10.0 vortex-compact 5.86 KB 5.82 KB 32 B -0.5%

Totals:

  • vortex-compact: 1.97 GB → 1.97 GB (-0.0%)
  • vortex-file-compressed: 2.70 GB → 2.70 GB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Vortex (geomean): 1.008x ➖
Parquet (geomean): 1.005x ➖
Shifts: Parquet (control) +0.5% · Median polish +0.0%


datafusion / vortex-file-compressed (1.012x ➖, 0↑ 2↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1642721 1636563 1.00
clickbench_q01/datafusion:vortex-file-compressed 19953243 18752227 1.06
clickbench_q02/datafusion:vortex-file-compressed 37806088 38094401 0.99
clickbench_q03/datafusion:vortex-file-compressed 43958325 42915658 1.02
clickbench_q04/datafusion:vortex-file-compressed 284484342 278092250 1.02
clickbench_q05/datafusion:vortex-file-compressed 309767463 311092424 1.00
clickbench_q06/datafusion:vortex-file-compressed 🚨 1875334 1695855 1.11
clickbench_q07/datafusion:vortex-file-compressed 22764981 22530629 1.01
clickbench_q08/datafusion:vortex-file-compressed 351432352 351069919 1.00
clickbench_q09/datafusion:vortex-file-compressed 544054266 527766409 1.03
clickbench_q10/datafusion:vortex-file-compressed 75974770 72916462 1.04
clickbench_q11/datafusion:vortex-file-compressed 85893648 85436816 1.01
clickbench_q12/datafusion:vortex-file-compressed 266449285 259125442 1.03
clickbench_q13/datafusion:vortex-file-compressed 415087386 406327418 1.02
clickbench_q14/datafusion:vortex-file-compressed 258207604 255627136 1.01
clickbench_q15/datafusion:vortex-file-compressed 327235023 320571561 1.02
clickbench_q16/datafusion:vortex-file-compressed 650700371 627800413 1.04
clickbench_q17/datafusion:vortex-file-compressed 632671940 632886458 1.00
clickbench_q18/datafusion:vortex-file-compressed 1291520659 1273710757 1.01
clickbench_q19/datafusion:vortex-file-compressed 31206147 31101438 1.00
clickbench_q20/datafusion:vortex-file-compressed 347181288 343343523 1.01
clickbench_q21/datafusion:vortex-file-compressed 375381136 372569771 1.01
clickbench_q22/datafusion:vortex-file-compressed 450051960 445421565 1.01
clickbench_q23/datafusion:vortex-file-compressed 🚨 700662931 625652594 1.12
clickbench_q24/datafusion:vortex-file-compressed 44072081 45096403 0.98
clickbench_q25/datafusion:vortex-file-compressed 73691287 72187490 1.02
clickbench_q26/datafusion:vortex-file-compressed 44860509 45813089 0.98
clickbench_q27/datafusion:vortex-file-compressed 712371263 732216652 0.97
clickbench_q28/datafusion:vortex-file-compressed 6536203013 6603788812 0.99
clickbench_q29/datafusion:vortex-file-compressed 233859935 241091065 0.97
clickbench_q30/datafusion:vortex-file-compressed 216682044 214178952 1.01
clickbench_q31/datafusion:vortex-file-compressed 250851479 256489741 0.98
clickbench_q32/datafusion:vortex-file-compressed 1111512619 1089011353 1.02
clickbench_q33/datafusion:vortex-file-compressed 1307559972 1273934862 1.03
clickbench_q34/datafusion:vortex-file-compressed 1283614819 1276275177 1.01
clickbench_q35/datafusion:vortex-file-compressed 454830148 442521021 1.03
clickbench_q36/datafusion:vortex-file-compressed 69235036 67750609 1.02
clickbench_q37/datafusion:vortex-file-compressed 34374440 34779309 0.99
clickbench_q38/datafusion:vortex-file-compressed 18196541 18541625 0.98
clickbench_q39/datafusion:vortex-file-compressed 128971556 131210922 0.98
clickbench_q40/datafusion:vortex-file-compressed 15367533 15410057 1.00
clickbench_q41/datafusion:vortex-file-compressed 14121568 14813470 0.95
clickbench_q42/datafusion:vortex-file-compressed 16785261 16129220 1.04
datafusion / parquet (1.010x ➖, 0↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1521162 1527462 1.00
clickbench_q01/datafusion:parquet 19017144 19292181 0.99
clickbench_q02/datafusion:parquet 45502537 46987249 0.97
clickbench_q03/datafusion:parquet 36550275 37929214 0.96
clickbench_q04/datafusion:parquet 291643308 294823570 0.99
clickbench_q05/datafusion:parquet 344730480 344544588 1.00
clickbench_q06/datafusion:parquet 1641662 1607663 1.02
clickbench_q07/datafusion:parquet 22784715 21957981 1.04
clickbench_q08/datafusion:parquet 368598458 363360764 1.01
clickbench_q09/datafusion:parquet 611211772 589545027 1.04
clickbench_q10/datafusion:parquet 104664864 104769888 1.00
clickbench_q11/datafusion:parquet 127742495 128617991 0.99
clickbench_q12/datafusion:parquet 335402713 336327566 1.00
clickbench_q13/datafusion:parquet 495206914 488539631 1.01
clickbench_q14/datafusion:parquet 350221292 347494929 1.01
clickbench_q15/datafusion:parquet 338193408 334401309 1.01
clickbench_q16/datafusion:parquet 660038405 645625920 1.02
clickbench_q17/datafusion:parquet 643518729 642235977 1.00
clickbench_q18/datafusion:parquet 1381094666 1308172545 1.06
clickbench_q19/datafusion:parquet 29605789 29208741 1.01
clickbench_q20/datafusion:parquet 605998824 587671098 1.03
clickbench_q21/datafusion:parquet 655696581 649233855 1.01
clickbench_q22/datafusion:parquet 961538722 958229182 1.00
clickbench_q23/datafusion:parquet 3628074306 3590369188 1.01
clickbench_q24/datafusion:parquet 81452160 81363411 1.00
clickbench_q25/datafusion:parquet 132270654 130491694 1.01
clickbench_q26/datafusion:parquet 81243587 83412017 0.97
clickbench_q27/datafusion:parquet 1047811471 1032893617 1.01
clickbench_q28/datafusion:parquet 6474341834 6593523268 0.98
clickbench_q29/datafusion:parquet 237219951 236003360 1.01
clickbench_q30/datafusion:parquet 319286245 316308803 1.01
clickbench_q31/datafusion:parquet 359140139 360030026 1.00
clickbench_q32/datafusion:parquet 1179108805 1148471912 1.03
clickbench_q33/datafusion:parquet 1476774880 1447106363 1.02
clickbench_q34/datafusion:parquet 1468519793 1440145359 1.02
clickbench_q35/datafusion:parquet 462297048 454269582 1.02
clickbench_q36/datafusion:parquet 139257293 135498906 1.03
clickbench_q37/datafusion:parquet 57116584 56408176 1.01
clickbench_q38/datafusion:parquet 85717500 82913542 1.03
clickbench_q39/datafusion:parquet 255823623 257233871 0.99
clickbench_q40/datafusion:parquet 30500498 29632786 1.03
clickbench_q41/datafusion:parquet 27040620 26434940 1.02
clickbench_q42/datafusion:parquet 30292222 28654009 1.06
duckdb / vortex-file-compressed (1.004x ➖, 1↑ 3↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6174756 6295831 0.98
clickbench_q01/duckdb:vortex-file-compressed 12270014 11461391 1.07
clickbench_q02/duckdb:vortex-file-compressed 26035445 25987773 1.00
clickbench_q03/duckdb:vortex-file-compressed 29591077 31074946 0.95
clickbench_q04/duckdb:vortex-file-compressed 185697031 189399940 0.98
clickbench_q05/duckdb:vortex-file-compressed 170138314 176875130 0.96
clickbench_q06/duckdb:vortex-file-compressed 19634469 20370587 0.96
clickbench_q07/duckdb:vortex-file-compressed 15293644 15892081 0.96
clickbench_q08/duckdb:vortex-file-compressed 258529252 265005259 0.98
clickbench_q09/duckdb:vortex-file-compressed 335418701 337669651 0.99
clickbench_q10/duckdb:vortex-file-compressed 67956769 68305568 0.99
clickbench_q11/duckdb:vortex-file-compressed 77341313 78040230 0.99
clickbench_q12/duckdb:vortex-file-compressed 199276169 193710960 1.03
clickbench_q13/duckdb:vortex-file-compressed 406936846 402712009 1.01
clickbench_q14/duckdb:vortex-file-compressed 231092184 228362542 1.01
clickbench_q15/duckdb:vortex-file-compressed 240084651 242117866 0.99
clickbench_q16/duckdb:vortex-file-compressed 524019513 525346004 1.00
clickbench_q17/duckdb:vortex-file-compressed 426137251 422847904 1.01
clickbench_q18/duckdb:vortex-file-compressed 945951922 934781269 1.01
clickbench_q19/duckdb:vortex-file-compressed 20599701 20987396 0.98
clickbench_q20/duckdb:vortex-file-compressed 328581554 334423774 0.98
clickbench_q21/duckdb:vortex-file-compressed 377450059 368609219 1.02
clickbench_q22/duckdb:vortex-file-compressed 509880675 512317725 1.00
clickbench_q23/duckdb:vortex-file-compressed 178192544 191459351 0.93
clickbench_q24/duckdb:vortex-file-compressed 36280292 36959664 0.98
clickbench_q25/duckdb:vortex-file-compressed 72485205 71077905 1.02
clickbench_q26/duckdb:vortex-file-compressed 🚨 49295007 44276670 1.11
clickbench_q27/duckdb:vortex-file-compressed 483740676 488077240 0.99
clickbench_q28/duckdb:vortex-file-compressed 2999586394 3002552338 1.00
clickbench_q29/duckdb:vortex-file-compressed 🚀 28746804 33036232 0.87
clickbench_q30/duckdb:vortex-file-compressed 194124069 191976282 1.01
clickbench_q31/duckdb:vortex-file-compressed 279746730 285341354 0.98
clickbench_q32/duckdb:vortex-file-compressed 1120478474 1124122541 1.00
clickbench_q33/duckdb:vortex-file-compressed 1043732084 1067182723 0.98
clickbench_q34/duckdb:vortex-file-compressed 1136817120 1141544838 1.00
clickbench_q35/duckdb:vortex-file-compressed 373475146 380376769 0.98
clickbench_q36/duckdb:vortex-file-compressed 27519948 26217603 1.05
clickbench_q37/duckdb:vortex-file-compressed 🚨 20437656 18502070 1.10
clickbench_q38/duckdb:vortex-file-compressed 21454665 19645836 1.09
clickbench_q39/duckdb:vortex-file-compressed 39654584 41491643 0.96
clickbench_q40/duckdb:vortex-file-compressed 19958202 18426294 1.08
clickbench_q41/duckdb:vortex-file-compressed 20285177 19640530 1.03
clickbench_q42/duckdb:vortex-file-compressed 🚨 22388314 18821609 1.19
duckdb / parquet (1.001x ➖, 0↑ 1↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 21912497 21858088 1.00
clickbench_q01/duckdb:parquet 29438219 32193059 0.91
clickbench_q02/duckdb:parquet 49711048 50266869 0.99
clickbench_q03/duckdb:parquet 41230092 41429012 1.00
clickbench_q04/duckdb:parquet 202941724 201442271 1.01
clickbench_q05/duckdb:parquet 261345689 256016798 1.02
clickbench_q06/duckdb:parquet 47948540 46961857 1.02
clickbench_q07/duckdb:parquet 32069061 30956151 1.04
clickbench_q08/duckdb:parquet 270777353 268759207 1.01
clickbench_q09/duckdb:parquet 399145357 403054705 0.99
clickbench_q10/duckdb:parquet 81559588 83299796 0.98
clickbench_q11/duckdb:parquet 100771244 99867116 1.01
clickbench_q12/duckdb:parquet 280464770 281960978 0.99
clickbench_q13/duckdb:parquet 469985648 468492966 1.00
clickbench_q14/duckdb:parquet 315239061 314241865 1.00
clickbench_q15/duckdb:parquet 252564931 255623687 0.99
clickbench_q16/duckdb:parquet 595414841 594867095 1.00
clickbench_q17/duckdb:parquet 501166854 496023864 1.01
clickbench_q18/duckdb:parquet 1028776849 1030796317 1.00
clickbench_q19/duckdb:parquet 27564128 27973450 0.99
clickbench_q20/duckdb:parquet 413418805 415987425 0.99
clickbench_q21/duckdb:parquet 529818540 530916613 1.00
clickbench_q22/duckdb:parquet 917830699 919671929 1.00
clickbench_q23/duckdb:parquet 258862668 263151756 0.98
clickbench_q24/duckdb:parquet 68235749 70003110 0.97
clickbench_q25/duckdb:parquet 164134509 162380763 1.01
clickbench_q26/duckdb:parquet 54043565 53519758 1.01
clickbench_q27/duckdb:parquet 641594470 640384637 1.00
clickbench_q28/duckdb:parquet 4841382808 4884221770 0.99
clickbench_q29/duckdb:parquet 42429051 41754039 1.02
clickbench_q30/duckdb:parquet 310029216 311991694 0.99
clickbench_q31/duckdb:parquet 373191115 379591650 0.98
clickbench_q32/duckdb:parquet 1111423436 1101051732 1.01
clickbench_q33/duckdb:parquet 1095098202 1090029557 1.00
clickbench_q34/duckdb:parquet 1149546321 1148874517 1.00
clickbench_q35/duckdb:parquet 366520113 368130165 1.00
clickbench_q36/duckdb:parquet 50491325 48415730 1.04
clickbench_q37/duckdb:parquet 34462520 34270637 1.01
clickbench_q38/duckdb:parquet 35307103 38187912 0.92
clickbench_q39/duckdb:parquet 🚨 87202943 78042139 1.12
clickbench_q40/duckdb:parquet 19691289 19711960 1.00
clickbench_q41/duckdb:parquet 20664948 20701332 1.00
clickbench_q42/duckdb:parquet 23215632 22526273 1.03
duckdb / duckdb (0.994x ➖, 0↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17093611 17714420 0.96
clickbench_q01/duckdb:duckdb 34967363 34813838 1.00
clickbench_q02/duckdb:duckdb 50890977 52109905 0.98
clickbench_q03/duckdb:duckdb 55509964 55662276 1.00
clickbench_q04/duckdb:duckdb 207708833 209723493 0.99
clickbench_q05/duckdb:duckdb 283437469 280955400 1.01
clickbench_q06/duckdb:duckdb 33716318 35063840 0.96
clickbench_q07/duckdb:duckdb 34903306 35449193 0.98
clickbench_q08/duckdb:duckdb 271194622 276087029 0.98
clickbench_q09/duckdb:duckdb 392416393 393012242 1.00
clickbench_q10/duckdb:duckdb 116710714 117719721 0.99
clickbench_q11/duckdb:duckdb 125692067 125265337 1.00
clickbench_q12/duckdb:duckdb 258840442 259672664 1.00
clickbench_q13/duckdb:duckdb 443559428 439213480 1.01
clickbench_q14/duckdb:duckdb 284185348 285858419 0.99
clickbench_q15/duckdb:duckdb 241038212 242377462 0.99
clickbench_q16/duckdb:duckdb 558423465 559105532 1.00
clickbench_q17/duckdb:duckdb 471055661 467559772 1.01
clickbench_q18/duckdb:duckdb 989351207 998174534 0.99
clickbench_q19/duckdb:duckdb 35351419 35588955 0.99
clickbench_q20/duckdb:duckdb 494849070 479543234 1.03
clickbench_q21/duckdb:duckdb 481090930 469140060 1.03
clickbench_q22/duckdb:duckdb 538334209 541859151 0.99
clickbench_q23/duckdb:duckdb 259303163 246511397 1.05
clickbench_q24/duckdb:duckdb 60791092 60985322 1.00
clickbench_q25/duckdb:duckdb 149631801 148212189 1.01
clickbench_q26/duckdb:duckdb 61158573 61936397 0.99
clickbench_q27/duckdb:duckdb 557226574 546293698 1.02
clickbench_q28/duckdb:duckdb 4466453180 4495607388 0.99
clickbench_q29/duckdb:duckdb 50179984 51835939 0.97
clickbench_q30/duckdb:duckdb 274333968 276368895 0.99
clickbench_q31/duckdb:duckdb 360374795 367132568 0.98
clickbench_q32/duckdb:duckdb 1109392037 1111075987 1.00
clickbench_q33/duckdb:duckdb 1112670978 1103666294 1.01
clickbench_q34/duckdb:duckdb 1194188926 1178553622 1.01
clickbench_q35/duckdb:duckdb 295161847 297156965 0.99
clickbench_q36/duckdb:duckdb 49167504 51552772 0.95
clickbench_q37/duckdb:duckdb 29097041 29703591 0.98
clickbench_q38/duckdb:duckdb 33489798 34252262 0.98
clickbench_q39/duckdb:duckdb 80317704 85075119 0.94
clickbench_q40/duckdb:duckdb 28418397 28735988 0.99
clickbench_q41/duckdb:duckdb 27764944 27867250 1.00
clickbench_q42/duckdb:duckdb 30422534 30133307 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +0.4% -0.1% +0.5% +755.2% ➖ noise
0 duckdb:duckdb -3.5% -0.1% -3.4% +273.3% ➖ noise
0 duckdb:vortex-file-compressed -1.9% -0.1% -1.8% +468.1% ➖ noise
1 datafusion:vortex-file-compressed +6.4% -5.1% +12.1% +23.3% ➖ noise
1 duckdb:duckdb +0.4% -5.1% +5.8% +44.9% ➖ noise
1 duckdb:vortex-file-compressed +7.1% -5.1% +12.8% +24.3% ➖ noise
2 datafusion:vortex-file-compressed -0.8% -2.1% +1.4% +14.3% ➖ noise
2 duckdb:duckdb -2.3% -2.1% -0.2% +20.2% ➖ noise
2 duckdb:vortex-file-compressed +0.2% -2.1% +2.4% +13.5% ➖ noise
3 datafusion:vortex-file-compressed +2.4% -2.1% +4.6% +136.1% ➖ noise
3 duckdb:duckdb -0.3% -2.1% +1.8% +35.9% ➖ noise
3 duckdb:vortex-file-compressed -4.8% -2.1% -2.8% +71.7% ➖ noise
4 datafusion:vortex-file-compressed +2.3% -0.2% +2.5% +10.0% ➖ noise
4 duckdb:duckdb -1.0% -0.2% -0.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -2.0% -0.2% -1.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -0.4% +1.1% -1.5% +10.0% ➖ noise
5 duckdb:duckdb +0.9% +1.1% -0.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -3.8% +1.1% -4.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +10.6% +2.1% +8.3% +83.0% ➖ noise
6 duckdb:duckdb -3.8% +2.1% -5.8% +15.1% ➖ noise
6 duckdb:vortex-file-compressed -3.6% +2.1% -5.6% +15.8% ➖ noise
7 datafusion:vortex-file-compressed +1.0% +3.7% -2.5% +11.8% ➖ noise
7 duckdb:duckdb -1.5% +3.7% -5.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -3.8% +3.7% -7.2% +13.3% ➖ noise
8 datafusion:vortex-file-compressed +0.1% +1.1% -1.0% +10.0% ➖ noise
8 duckdb:duckdb -1.8% +1.1% -2.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -2.4% +1.1% -3.5% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +3.1% +1.3% +1.7% +10.0% ➖ noise
9 duckdb:duckdb -0.2% +1.3% -1.5% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.7% +1.3% -2.0% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +4.2% -1.1% +5.4% +10.0% ➖ noise
10 duckdb:duckdb -0.9% -1.1% +0.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.5% -1.1% +0.6% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +0.5% +0.1% +0.4% +10.0% ➖ noise
11 duckdb:duckdb +0.3% +0.1% +0.2% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -0.9% +0.1% -1.0% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +2.8% -0.4% +3.2% +10.0% ➖ noise
12 duckdb:duckdb -0.3% -0.4% +0.1% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +2.9% -0.4% +3.3% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +2.2% +0.8% +1.3% +10.0% ➖ noise
13 duckdb:duckdb +1.0% +0.8% +0.1% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +1.0% +0.8% +0.2% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +1.0% +0.6% +0.5% +10.0% ➖ noise
14 duckdb:duckdb -0.6% +0.6% -1.1% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +1.2% +0.6% +0.6% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +2.1% -0.0% +2.1% +10.0% ➖ noise
15 duckdb:duckdb -0.6% -0.0% -0.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.8% -0.0% -0.8% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +3.6% +1.2% +2.5% +10.0% ➖ noise
16 duckdb:duckdb -0.1% +1.2% -1.3% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -0.3% +1.2% -1.4% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -0.0% +0.6% -0.6% +10.0% ➖ noise
17 duckdb:duckdb +0.7% +0.6% +0.1% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +0.8% +0.6% +0.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +1.4% +2.6% -1.2% +10.0% ➖ noise
18 duckdb:duckdb -0.9% +2.6% -3.4% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +1.2% +2.6% -1.4% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +0.3% -0.1% +0.4% +23.8% ➖ noise
19 duckdb:duckdb -0.7% -0.1% -0.6% +12.2% ➖ noise
19 duckdb:vortex-file-compressed -1.8% -0.1% -1.8% +20.1% ➖ noise
20 datafusion:vortex-file-compressed +1.1% +1.2% -0.1% +205.3% ➖ noise
20 duckdb:duckdb +3.2% +1.2% +1.9% +62.8% ➖ noise
20 duckdb:vortex-file-compressed -1.7% +1.2% -2.9% +83.9% ➖ noise
21 datafusion:vortex-file-compressed +0.8% +0.4% +0.4% +10.0% ➖ noise
21 duckdb:duckdb +2.5% +0.4% +2.1% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +2.4% +0.4% +2.0% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +1.0% +0.1% +1.0% +15.4% ➖ noise
22 duckdb:duckdb -0.7% +0.1% -0.7% +31.6% ➖ noise
22 duckdb:vortex-file-compressed -0.5% +0.1% -0.5% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +12.0% -0.3% +12.3% +46.7% ➖ noise
23 duckdb:duckdb +5.2% -0.3% +5.5% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -6.9% -0.3% -6.7% +18.8% ➖ noise
24 datafusion:vortex-file-compressed -2.3% -1.2% -1.1% +10.0% ➖ noise
24 duckdb:duckdb -0.3% -1.2% +0.9% +29.1% ➖ noise
24 duckdb:vortex-file-compressed -1.8% -1.2% -0.6% +14.9% ➖ noise
25 datafusion:vortex-file-compressed +2.1% +1.2% +0.9% +10.0% ➖ noise
25 duckdb:duckdb +1.0% +1.2% -0.3% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +2.0% +1.2% +0.7% +10.6% ➖ noise
26 datafusion:vortex-file-compressed -2.1% -0.8% -1.3% +10.0% ➖ noise
26 duckdb:duckdb -1.3% -0.8% -0.4% +10.0% ➖ noise
26 duckdb:vortex-file-compressed +11.3% -0.8% +12.3% +22.7% ➖ noise
27 datafusion:vortex-file-compressed -2.7% +0.8% -3.5% +10.0% ➖ noise
27 duckdb:duckdb +2.0% +0.8% +1.2% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -0.9% +0.8% -1.7% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -1.0% -1.3% +0.3% +13.9% ➖ noise
28 duckdb:duckdb -0.6% -1.3% +0.7% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.1% -1.3% +1.3% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -3.0% +1.1% -4.0% +10.0% ➖ noise
29 duckdb:duckdb -3.2% +1.1% -4.2% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -13.0% +1.1% -13.9% +24.1% ➖ noise
30 datafusion:vortex-file-compressed +1.2% +0.2% +1.0% +10.0% ➖ noise
30 duckdb:duckdb -0.7% +0.2% -0.9% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +1.1% +0.2% +1.0% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -2.2% -1.0% -1.2% +10.0% ➖ noise
31 duckdb:duckdb -1.8% -1.0% -0.9% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -2.0% -1.0% -1.0% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +2.1% +1.8% +0.3% +10.0% ➖ noise
32 duckdb:duckdb -0.2% +1.8% -1.9% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -0.3% +1.8% -2.1% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +2.6% +1.3% +1.4% +10.0% ➖ noise
33 duckdb:duckdb +0.8% +1.3% -0.4% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -2.2% +1.3% -3.4% +23.1% ➖ noise
34 datafusion:vortex-file-compressed +0.6% +1.0% -0.4% +10.0% ➖ noise
34 duckdb:duckdb +1.3% +1.0% +0.3% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -0.4% +1.0% -1.4% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +2.8% +0.7% +2.1% +10.0% ➖ noise
35 duckdb:duckdb -0.7% +0.7% -1.3% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -1.8% +0.7% -2.5% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +2.2% +3.5% -1.3% +10.0% ➖ noise
36 duckdb:duckdb -4.6% +3.5% -7.9% +19.1% ➖ noise
36 duckdb:vortex-file-compressed +5.0% +3.5% +1.4% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -1.2% +0.9% -2.1% +10.3% ➖ noise
37 duckdb:duckdb -2.0% +0.9% -2.9% +11.5% ➖ noise
37 duckdb:vortex-file-compressed +10.5% +0.9% +9.5% +10.2% ➖ noise
38 datafusion:vortex-file-compressed -1.9% -2.2% +0.4% +10.0% ➖ noise
38 duckdb:duckdb -2.2% -2.2% +0.0% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +9.2% -2.2% +11.7% +25.6% ➖ noise
39 datafusion:vortex-file-compressed -1.7% +5.4% -6.8% +12.4% ➖ noise
39 duckdb:duckdb -5.6% +5.4% -10.4% +18.7% ➖ noise
39 duckdb:vortex-file-compressed -4.4% +5.4% -9.3% +10.0% ✅ faster
40 datafusion:vortex-file-compressed -0.3% +1.4% -1.7% +10.0% ➖ noise
40 duckdb:duckdb -1.1% +1.4% -2.5% +10.0% ➖ noise
40 duckdb:vortex-file-compressed +8.3% +1.4% +6.8% +26.8% ➖ noise
41 datafusion:vortex-file-compressed -4.7% +1.1% -5.7% +10.0% ➖ noise
41 duckdb:duckdb -0.4% +1.1% -1.4% +10.1% ➖ noise
41 duckdb:vortex-file-compressed +3.3% +1.1% +2.2% +11.4% ➖ noise
42 datafusion:vortex-file-compressed +4.1% +4.4% -0.3% +14.5% ➖ noise
42 duckdb:duckdb +1.0% +4.4% -3.3% +10.6% ➖ noise
42 duckdb:vortex-file-compressed +19.0% +4.4% +14.0% +18.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Clickbench on NVME

File Size Changes (201 files changed, -0.0% overall, 0↑ 201↓)
File Scale Format Base HEAD Change %
hits_51.vortex 1.0 vortex-file-compressed 428.84 MB 428.84 MB 32 B -0.0%
hits_54.vortex 1.0 vortex-file-compressed 361.83 MB 361.83 MB 32 B -0.0%
hits_43.vortex 1.0 vortex-file-compressed 305.71 MB 305.71 MB 32 B -0.0%
hits_41.vortex 1.0 vortex-file-compressed 300.49 MB 300.49 MB 32 B -0.0%
hits_42.vortex 1.0 vortex-file-compressed 298.79 MB 298.79 MB 32 B -0.0%
hits_89.vortex 1.0 vortex-file-compressed 266.01 MB 266.01 MB 32 B -0.0%
hits_67.vortex 1.0 vortex-file-compressed 265.94 MB 265.94 MB 32 B -0.0%
hits_50.vortex 1.0 vortex-file-compressed 255.24 MB 255.24 MB 32 B -0.0%
hits_55.vortex 1.0 vortex-file-compressed 251.56 MB 251.56 MB 32 B -0.0%
hits_44.vortex 1.0 vortex-file-compressed 243.64 MB 243.64 MB 32 B -0.0%
hits_2.vortex 1.0 vortex-file-compressed 241.46 MB 241.46 MB 32 B -0.0%
hits_78.vortex 1.0 vortex-file-compressed 238.59 MB 238.59 MB 32 B -0.0%
hits_65.vortex 1.0 vortex-file-compressed 238.05 MB 238.05 MB 32 B -0.0%
hits_87.vortex 1.0 vortex-file-compressed 221.68 MB 221.68 MB 32 B -0.0%
hits_77.vortex 1.0 vortex-file-compressed 218.96 MB 218.96 MB 32 B -0.0%
hits_79.vortex 1.0 vortex-file-compressed 204.16 MB 204.16 MB 32 B -0.0%
hits_90.vortex 1.0 vortex-file-compressed 204.12 MB 204.12 MB 32 B -0.0%
hits_92.vortex 1.0 vortex-file-compressed 196.47 MB 196.47 MB 32 B -0.0%
hits_3.vortex 1.0 vortex-file-compressed 193.11 MB 193.11 MB 32 B -0.0%
hits_94.vortex 1.0 vortex-file-compressed 185.12 MB 185.12 MB 32 B -0.0%
hits_1.vortex 1.0 vortex-file-compressed 181.16 MB 181.16 MB 32 B -0.0%
hits_96.vortex 1.0 vortex-file-compressed 180.76 MB 180.76 MB 32 B -0.0%
hits_27.vortex 1.0 vortex-file-compressed 174.61 MB 174.61 MB 32 B -0.0%
hits_68.vortex 1.0 vortex-file-compressed 172.16 MB 172.16 MB 32 B -0.0%
hits_43.vortex 1.0 vortex-compact 168.91 MB 168.91 MB 32 B -0.0%
hits_51.vortex 1.0 vortex-compact 167.81 MB 167.81 MB 32 B -0.0%
hits_28.vortex 1.0 vortex-file-compressed 167.55 MB 167.55 MB 32 B -0.0%
hits_41.vortex 1.0 vortex-compact 165.78 MB 165.78 MB 32 B -0.0%
hits_42.vortex 1.0 vortex-compact 164.22 MB 164.22 MB 32 B -0.0%
hits_56.vortex 1.0 vortex-file-compressed 163.76 MB 163.76 MB 32 B -0.0%
hits_99.vortex 1.0 vortex-file-compressed 158.88 MB 158.88 MB 32 B -0.0%
hits_57.vortex 1.0 vortex-file-compressed 158.37 MB 158.37 MB 32 B -0.0%
hits_74.vortex 1.0 vortex-file-compressed 152.12 MB 152.12 MB 32 B -0.0%
hits_98.vortex 1.0 vortex-file-compressed 150.55 MB 150.55 MB 32 B -0.0%
hits_62.vortex 1.0 vortex-file-compressed 148.36 MB 148.36 MB 32 B -0.0%
hits_69.vortex 1.0 vortex-file-compressed 147.61 MB 147.61 MB 32 B -0.0%
hits_45.vortex 1.0 vortex-file-compressed 145.48 MB 145.48 MB 32 B -0.0%
hits_84.vortex 1.0 vortex-file-compressed 145.05 MB 145.05 MB 32 B -0.0%
hits_26.vortex 1.0 vortex-file-compressed 144.05 MB 144.05 MB 32 B -0.0%
hits_40.vortex 1.0 vortex-file-compressed 142.99 MB 142.99 MB 32 B -0.0%
hits_76.vortex 1.0 vortex-file-compressed 140.05 MB 140.05 MB 32 B -0.0%
hits_4.vortex 1.0 vortex-file-compressed 138.86 MB 138.86 MB 32 B -0.0%
hits_35.vortex 1.0 vortex-file-compressed 138.81 MB 138.81 MB 32 B -0.0%
hits_88.vortex 1.0 vortex-file-compressed 137.34 MB 137.34 MB 32 B -0.0%
hits_25.vortex 1.0 vortex-file-compressed 137.01 MB 137.01 MB 32 B -0.0%
hits_14.vortex 1.0 vortex-file-compressed 135.14 MB 135.14 MB 32 B -0.0%
hits_44.vortex 1.0 vortex-compact 132.46 MB 132.46 MB 32 B -0.0%
hits_73.vortex 1.0 vortex-file-compressed 131.83 MB 131.83 MB 32 B -0.0%
hits_97.vortex 1.0 vortex-file-compressed 130.96 MB 130.96 MB 32 B -0.0%
hits_65.vortex 1.0 vortex-compact 129.95 MB 129.95 MB 32 B -0.0%
hits_2.vortex 1.0 vortex-compact 129.36 MB 129.36 MB 32 B -0.0%
hits_81.vortex 1.0 vortex-file-compressed 126.55 MB 126.55 MB 32 B -0.0%
hits_71.vortex 1.0 vortex-file-compressed 126.41 MB 126.41 MB 32 B -0.0%
hits_18.vortex 1.0 vortex-file-compressed 126.06 MB 126.06 MB 32 B -0.0%
hits_12.vortex 1.0 vortex-file-compressed 125.34 MB 125.34 MB 32 B -0.0%
hits_80.vortex 1.0 vortex-file-compressed 124.24 MB 124.24 MB 32 B -0.0%
hits_9.vortex 1.0 vortex-file-compressed 124.22 MB 124.22 MB 32 B -0.0%
hits_7.vortex 1.0 vortex-file-compressed 123.82 MB 123.82 MB 32 B -0.0%
hits_13.vortex 1.0 vortex-file-compressed 123.20 MB 123.20 MB 32 B -0.0%
hits_6.vortex 1.0 vortex-file-compressed 122.86 MB 122.86 MB 32 B -0.0%
hits_8.vortex 1.0 vortex-file-compressed 122.86 MB 122.86 MB 32 B -0.0%
hits_82.vortex 1.0 vortex-file-compressed 122.77 MB 122.77 MB 32 B -0.0%
hits_5.vortex 1.0 vortex-file-compressed 122.64 MB 122.64 MB 32 B -0.0%
hits_59.vortex 1.0 vortex-file-compressed 121.84 MB 121.84 MB 32 B -0.0%
hits_60.vortex 1.0 vortex-file-compressed 121.19 MB 121.19 MB 32 B -0.0%
hits_52.vortex 1.0 vortex-file-compressed 120.78 MB 120.78 MB 32 B -0.0%
hits_87.vortex 1.0 vortex-compact 119.04 MB 119.04 MB 32 B -0.0%
hits_38.vortex 1.0 vortex-file-compressed 118.43 MB 118.43 MB 32 B -0.0%
hits_77.vortex 1.0 vortex-compact 118.11 MB 118.11 MB 32 B -0.0%
hits_54.vortex 1.0 vortex-compact 117.66 MB 117.66 MB 32 B -0.0%
hits_91.vortex 1.0 vortex-file-compressed 116.23 MB 116.23 MB 32 B -0.0%
hits_70.vortex 1.0 vortex-file-compressed 115.14 MB 115.14 MB 32 B -0.0%
hits_61.vortex 1.0 vortex-file-compressed 114.43 MB 114.43 MB 32 B -0.0%
hits_95.vortex 1.0 vortex-file-compressed 114.33 MB 114.33 MB 32 B -0.0%
hits_67.vortex 1.0 vortex-compact 114.05 MB 114.05 MB 32 B -0.0%
hits_58.vortex 1.0 vortex-file-compressed 113.78 MB 113.78 MB 32 B -0.0%
hits_50.vortex 1.0 vortex-compact 113.12 MB 113.12 MB 32 B -0.0%
hits_89.vortex 1.0 vortex-compact 112.82 MB 112.82 MB 32 B -0.0%
hits_0.vortex 1.0 vortex-file-compressed 112.17 MB 112.17 MB 32 B -0.0%
hits_34.vortex 1.0 vortex-file-compressed 111.68 MB 111.68 MB 32 B -0.0%
hits_93.vortex 1.0 vortex-file-compressed 107.66 MB 107.66 MB 32 B -0.0%
hits_85.vortex 1.0 vortex-file-compressed 106.37 MB 106.37 MB 32 B -0.0%
hits_66.vortex 1.0 vortex-file-compressed 105.34 MB 105.34 MB 32 B -0.0%
hits_31.vortex 1.0 vortex-file-compressed 104.39 MB 104.39 MB 32 B -0.0%
hits_30.vortex 1.0 vortex-file-compressed 104.00 MB 104.00 MB 32 B -0.0%
hits_83.vortex 1.0 vortex-file-compressed 103.72 MB 103.72 MB 32 B -0.0%
hits_17.vortex 1.0 vortex-file-compressed 103.64 MB 103.64 MB 32 B -0.0%
hits_21.vortex 1.0 vortex-file-compressed 101.28 MB 101.28 MB 32 B -0.0%
hits_53.vortex 1.0 vortex-file-compressed 98.26 MB 98.26 MB 32 B -0.0%
hits_78.vortex 1.0 vortex-compact 97.87 MB 97.87 MB 32 B -0.0%
hits_37.vortex 1.0 vortex-file-compressed 97.54 MB 97.54 MB 32 B -0.0%
hits_15.vortex 1.0 vortex-file-compressed 97.01 MB 97.01 MB 32 B -0.0%
hits_72.vortex 1.0 vortex-file-compressed 96.27 MB 96.27 MB 32 B -0.0%
hits_11.vortex 1.0 vortex-file-compressed 96.07 MB 96.07 MB 32 B -0.0%
hits_64.vortex 1.0 vortex-file-compressed 95.27 MB 95.27 MB 32 B -0.0%
hits_92.vortex 1.0 vortex-compact 94.27 MB 94.27 MB 32 B -0.0%
hits_3.vortex 1.0 vortex-compact 94.23 MB 94.23 MB 32 B -0.0%
hits_39.vortex 1.0 vortex-file-compressed 94.06 MB 94.06 MB 32 B -0.0%
hits_55.vortex 1.0 vortex-compact 93.77 MB 93.77 MB 32 B -0.0%
hits_96.vortex 1.0 vortex-compact 91.08 MB 91.08 MB 32 B -0.0%
hits_94.vortex 1.0 vortex-compact 90.63 MB 90.63 MB 32 B -0.0%
hits_1.vortex 1.0 vortex-compact 90.34 MB 90.34 MB 32 B -0.0%
hits_49.vortex 1.0 vortex-file-compressed 88.67 MB 88.67 MB 32 B -0.0%
hits_16.vortex 1.0 vortex-file-compressed 87.59 MB 87.59 MB 32 B -0.0%
hits_79.vortex 1.0 vortex-compact 85.70 MB 85.70 MB 32 B -0.0%
hits_57.vortex 1.0 vortex-compact 83.54 MB 83.54 MB 32 B -0.0%
hits_19.vortex 1.0 vortex-file-compressed 82.10 MB 82.10 MB 32 B -0.0%
hits_90.vortex 1.0 vortex-compact 81.86 MB 81.86 MB 32 B -0.0%
hits_10.vortex 1.0 vortex-file-compressed 81.76 MB 81.76 MB 32 B -0.0%
hits_86.vortex 1.0 vortex-file-compressed 81.40 MB 81.40 MB 32 B -0.0%
hits_22.vortex 1.0 vortex-file-compressed 81.17 MB 81.17 MB 32 B -0.0%
hits_69.vortex 1.0 vortex-compact 81.02 MB 81.02 MB 32 B -0.0%
hits_63.vortex 1.0 vortex-file-compressed 80.62 MB 80.62 MB 32 B -0.0%
hits_23.vortex 1.0 vortex-file-compressed 80.37 MB 80.37 MB 32 B -0.0%
hits_46.vortex 1.0 vortex-file-compressed 80.32 MB 80.32 MB 32 B -0.0%
hits_36.vortex 1.0 vortex-file-compressed 80.27 MB 80.27 MB 32 B -0.0%
hits_24.vortex 1.0 vortex-file-compressed 79.71 MB 79.71 MB 32 B -0.0%
hits_56.vortex 1.0 vortex-compact 77.87 MB 77.87 MB 32 B -0.0%
hits_99.vortex 1.0 vortex-compact 77.31 MB 77.31 MB 32 B -0.0%
hits_32.vortex 1.0 vortex-file-compressed 77.12 MB 77.12 MB 32 B -0.0%
hits_76.vortex 1.0 vortex-compact 76.44 MB 76.44 MB 32 B -0.0%
hits_45.vortex 1.0 vortex-compact 76.07 MB 76.07 MB 32 B -0.0%
hits_68.vortex 1.0 vortex-compact 75.99 MB 75.99 MB 32 B -0.0%
hits_40.vortex 1.0 vortex-compact 75.92 MB 75.92 MB 32 B -0.0%
hits_35.vortex 1.0 vortex-compact 75.11 MB 75.11 MB 32 B -0.0%
hits_62.vortex 1.0 vortex-compact 74.26 MB 74.26 MB 32 B -0.0%
hits_75.vortex 1.0 vortex-file-compressed 74.18 MB 74.18 MB 32 B -0.0%
hits_14.vortex 1.0 vortex-compact 73.75 MB 73.75 MB 32 B -0.0%
hits_88.vortex 1.0 vortex-compact 73.31 MB 73.31 MB 32 B -0.0%
hits_84.vortex 1.0 vortex-compact 73.14 MB 73.14 MB 32 B -0.0%
hits_25.vortex 1.0 vortex-compact 73.14 MB 73.14 MB 32 B -0.0%
hits_98.vortex 1.0 vortex-compact 72.77 MB 72.77 MB 32 B -0.0%
hits_4.vortex 1.0 vortex-compact 71.81 MB 71.81 MB 32 B -0.0%
hits_74.vortex 1.0 vortex-compact 71.62 MB 71.62 MB 32 B -0.0%
hits_26.vortex 1.0 vortex-compact 70.89 MB 70.89 MB 32 B -0.0%
hits_28.vortex 1.0 vortex-compact 70.27 MB 70.27 MB 32 B -0.0%
hits_73.vortex 1.0 vortex-compact 70.04 MB 70.04 MB 32 B -0.0%
hits_27.vortex 1.0 vortex-compact 69.88 MB 69.88 MB 32 B -0.0%
hits_71.vortex 1.0 vortex-compact 69.29 MB 69.29 MB 32 B -0.0%
hits_12.vortex 1.0 vortex-compact 69.27 MB 69.27 MB 32 B -0.0%
hits_97.vortex 1.0 vortex-compact 69.16 MB 69.16 MB 32 B -0.0%
hits_80.vortex 1.0 vortex-compact 68.07 MB 68.07 MB 32 B -0.0%
hits_13.vortex 1.0 vortex-compact 67.96 MB 67.96 MB 32 B -0.0%
hits_20.vortex 1.0 vortex-file-compressed 67.53 MB 67.53 MB 32 B -0.0%
hits_82.vortex 1.0 vortex-compact 66.89 MB 66.89 MB 32 B -0.0%
hits_59.vortex 1.0 vortex-compact 66.30 MB 66.30 MB 32 B -0.0%
hits_9.vortex 1.0 vortex-compact 65.67 MB 65.67 MB 32 B -0.0%
hits_29.vortex 1.0 vortex-file-compressed 65.47 MB 65.47 MB 32 B -0.0%
hits_81.vortex 1.0 vortex-compact 65.45 MB 65.45 MB 32 B -0.0%
hits_60.vortex 1.0 vortex-compact 64.33 MB 64.33 MB 32 B -0.0%
hits_18.vortex 1.0 vortex-compact 64.28 MB 64.28 MB 32 B -0.0%
hits_7.vortex 1.0 vortex-compact 63.80 MB 63.80 MB 32 B -0.0%
hits_52.vortex 1.0 vortex-compact 63.73 MB 63.73 MB 32 B -0.0%
hits_6.vortex 1.0 vortex-compact 63.16 MB 63.16 MB 32 B -0.0%
hits_38.vortex 1.0 vortex-compact 63.10 MB 63.10 MB 32 B -0.0%
hits_33.vortex 1.0 vortex-file-compressed 62.97 MB 62.97 MB 32 B -0.0%
hits_5.vortex 1.0 vortex-compact 62.90 MB 62.90 MB 32 B -0.0%
hits_8.vortex 1.0 vortex-compact 62.89 MB 62.89 MB 32 B -0.0%
hits_70.vortex 1.0 vortex-compact 61.29 MB 61.29 MB 32 B -0.0%
hits_91.vortex 1.0 vortex-compact 60.94 MB 60.94 MB 32 B -0.0%
hits_58.vortex 1.0 vortex-compact 60.41 MB 60.41 MB 32 B -0.0%
hits_53.vortex 1.0 vortex-compact 59.09 MB 59.09 MB 32 B -0.0%
hits_93.vortex 1.0 vortex-compact 58.90 MB 58.90 MB 32 B -0.0%
hits_30.vortex 1.0 vortex-compact 58.69 MB 58.69 MB 32 B -0.0%
hits_0.vortex 1.0 vortex-compact 58.66 MB 58.66 MB 32 B -0.0%
hits_17.vortex 1.0 vortex-compact 58.32 MB 58.32 MB 32 B -0.0%
hits_34.vortex 1.0 vortex-compact 58.26 MB 58.26 MB 32 B -0.0%
hits_95.vortex 1.0 vortex-compact 57.75 MB 57.75 MB 32 B -0.0%
hits_61.vortex 1.0 vortex-compact 57.66 MB 57.66 MB 32 B -0.0%
hits_31.vortex 1.0 vortex-compact 55.56 MB 55.56 MB 32 B -0.0%
hits_11.vortex 1.0 vortex-compact 54.35 MB 54.35 MB 32 B -0.0%
hits_64.vortex 1.0 vortex-compact 53.91 MB 53.91 MB 32 B -0.0%
hits_37.vortex 1.0 vortex-compact 53.83 MB 53.83 MB 32 B -0.0%
hits_66.vortex 1.0 vortex-compact 53.49 MB 53.49 MB 32 B -0.0%
hits_85.vortex 1.0 vortex-compact 52.73 MB 52.73 MB 32 B -0.0%
hits_83.vortex 1.0 vortex-compact 52.57 MB 52.57 MB 32 B -0.0%
hits_72.vortex 1.0 vortex-compact 51.79 MB 51.79 MB 32 B -0.0%
hits_21.vortex 1.0 vortex-compact 51.60 MB 51.60 MB 32 B -0.0%
hits_49.vortex 1.0 vortex-compact 50.53 MB 50.53 MB 32 B -0.0%
hits_39.vortex 1.0 vortex-compact 49.82 MB 49.82 MB 32 B -0.0%
hits_36.vortex 1.0 vortex-compact 48.99 MB 48.99 MB 32 B -0.0%
hits_10.vortex 1.0 vortex-compact 48.86 MB 48.86 MB 32 B -0.0%
hits_16.vortex 1.0 vortex-compact 48.30 MB 48.30 MB 32 B -0.0%
hits_86.vortex 1.0 vortex-compact 48.25 MB 48.25 MB 32 B -0.0%
hits_15.vortex 1.0 vortex-compact 48.14 MB 48.14 MB 32 B -0.0%
hits_63.vortex 1.0 vortex-compact 46.10 MB 46.10 MB 32 B -0.0%
hits_19.vortex 1.0 vortex-compact 44.88 MB 44.88 MB 32 B -0.0%
hits_22.vortex 1.0 vortex-compact 44.74 MB 44.74 MB 32 B -0.0%
hits_23.vortex 1.0 vortex-compact 44.17 MB 44.17 MB 32 B -0.0%
hits_32.vortex 1.0 vortex-compact 44.13 MB 44.13 MB 32 B -0.0%
hits_24.vortex 1.0 vortex-compact 43.63 MB 43.63 MB 32 B -0.0%
hits_75.vortex 1.0 vortex-compact 43.63 MB 43.63 MB 32 B -0.0%
hits_46.vortex 1.0 vortex-compact 41.92 MB 41.92 MB 32 B -0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.86 MB 41.86 MB 32 B -0.0%
hits_20.vortex 1.0 vortex-compact 38.14 MB 38.14 MB 32 B -0.0%
hits_29.vortex 1.0 vortex-compact 36.61 MB 36.61 MB 32 B -0.0%
hits_33.vortex 1.0 vortex-compact 35.95 MB 35.95 MB 32 B -0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.53 MB 28.53 MB 32 B -0.0%
hits_47.vortex 1.0 vortex-compact 18.25 MB 18.25 MB 32 B -0.0%
hits_48.vortex 1.0 vortex-compact 17.32 MB 17.32 MB 32 B -0.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.1%
Vortex (geomean): 0.981x ➖
Parquet (geomean): 0.980x ➖
Shifts: Parquet (control) -2.0% · Median polish +1.6%


datafusion / vortex-file-compressed (0.881x ➖, 5↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 291331055 275828242 1.06
tpch_q02/datafusion:vortex-file-compressed 647332314 798716900 0.81
tpch_q03/datafusion:vortex-file-compressed 549877164 501667019 1.10
tpch_q04/datafusion:vortex-file-compressed 🚀 261279260 436719729 0.60
tpch_q05/datafusion:vortex-file-compressed 🚀 452309757 669322492 0.68
tpch_q06/datafusion:vortex-file-compressed 338592429 363179838 0.93
tpch_q07/datafusion:vortex-file-compressed 461219307 527862607 0.87
tpch_q08/datafusion:vortex-file-compressed 🚀 694083582 1026077149 0.68
tpch_q09/datafusion:vortex-file-compressed 473530975 654243831 0.72
tpch_q10/datafusion:vortex-file-compressed 🚀 576678793 859800126 0.67
tpch_q11/datafusion:vortex-file-compressed 368441153 450884064 0.82
tpch_q12/datafusion:vortex-file-compressed 560360035 542351724 1.03
tpch_q13/datafusion:vortex-file-compressed 217608850 195318693 1.11
tpch_q14/datafusion:vortex-file-compressed 317228886 386407292 0.82
tpch_q15/datafusion:vortex-file-compressed 702391589 562415399 1.25
tpch_q16/datafusion:vortex-file-compressed 219907526 231693961 0.95
tpch_q17/datafusion:vortex-file-compressed 532760366 540862911 0.99
tpch_q18/datafusion:vortex-file-compressed 589000097 468097594 1.26
tpch_q19/datafusion:vortex-file-compressed 678831384 631206210 1.08
tpch_q20/datafusion:vortex-file-compressed 481793356 578654607 0.83
tpch_q21/datafusion:vortex-file-compressed 697152180 789937857 0.88
tpch_q22/datafusion:vortex-file-compressed 🚀 150566917 224154100 0.67
datafusion / vortex-compact (1.008x ➖, 0↑ 1↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 315955752 248932151 1.27
tpch_q02/datafusion:vortex-compact 441982738 448730619 0.98
tpch_q03/datafusion:vortex-compact 374434188 365967088 1.02
tpch_q04/datafusion:vortex-compact 239804141 237006405 1.01
tpch_q05/datafusion:vortex-compact 491833240 433702246 1.13
tpch_q06/datafusion:vortex-compact 309307343 393804965 0.79
tpch_q07/datafusion:vortex-compact 501475806 485729333 1.03
tpch_q08/datafusion:vortex-compact 671467069 765267215 0.88
tpch_q09/datafusion:vortex-compact 🚨 652095681 486112763 1.34
tpch_q10/datafusion:vortex-compact 595817876 669744846 0.89
tpch_q11/datafusion:vortex-compact 377955437 489550348 0.77
tpch_q12/datafusion:vortex-compact 505380735 478367076 1.06
tpch_q13/datafusion:vortex-compact 165907264 184565115 0.90
tpch_q14/datafusion:vortex-compact 274803783 362422185 0.76
tpch_q15/datafusion:vortex-compact 420112215 559950170 0.75
tpch_q16/datafusion:vortex-compact 210141399 193190162 1.09
tpch_q17/datafusion:vortex-compact 424408204 378660005 1.12
tpch_q18/datafusion:vortex-compact 364811262 326168438 1.12
tpch_q19/datafusion:vortex-compact 561647350 510078364 1.10
tpch_q20/datafusion:vortex-compact 454628093 417307150 1.09
tpch_q21/datafusion:vortex-compact 679699993 579574926 1.17
tpch_q22/datafusion:vortex-compact 166797642 140583110 1.19
datafusion / parquet (0.953x ➖, 3↑ 3↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 272529666 265374427 1.03
tpch_q02/datafusion:parquet 393737844 392909473 1.00
tpch_q03/datafusion:parquet 🚀 305259978 507199526 0.60
tpch_q04/datafusion:parquet 161213681 206185456 0.78
tpch_q05/datafusion:parquet 512132495 610821954 0.84
tpch_q06/datafusion:parquet 164543085 161565981 1.02
tpch_q07/datafusion:parquet 514107088 523724902 0.98
tpch_q08/datafusion:parquet 673695002 555917099 1.21
tpch_q09/datafusion:parquet 🚨 738317005 457197641 1.61
tpch_q10/datafusion:parquet 563927754 521364919 1.08
tpch_q11/datafusion:parquet 313665514 304421333 1.03
tpch_q12/datafusion:parquet 🚀 262246102 393508175 0.67
tpch_q13/datafusion:parquet 470313844 582083681 0.81
tpch_q14/datafusion:parquet 🚀 273648985 467328362 0.59
tpch_q15/datafusion:parquet 440444868 547060584 0.81
tpch_q16/datafusion:parquet 🚨 262339637 198625213 1.32
tpch_q17/datafusion:parquet 605913219 633854605 0.96
tpch_q18/datafusion:parquet 471756486 648747074 0.73
tpch_q19/datafusion:parquet 409607551 371319390 1.10
tpch_q20/datafusion:parquet 334021461 363218624 0.92
tpch_q21/datafusion:parquet 652404615 540501246 1.21
tpch_q22/datafusion:parquet 🚨 165592581 121136949 1.37
duckdb / vortex-file-compressed (1.010x ➖, 0↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 327738744 304534812 1.08
tpch_q02/duckdb:vortex-file-compressed 1155168764 1131663141 1.02
tpch_q03/duckdb:vortex-file-compressed 697523190 722855956 0.96
tpch_q04/duckdb:vortex-file-compressed 467132174 541702983 0.86
tpch_q05/duckdb:vortex-file-compressed 1047048842 931734759 1.12
tpch_q06/duckdb:vortex-file-compressed 356197314 461561431 0.77
tpch_q07/duckdb:vortex-file-compressed 1044874997 1028199138 1.02
tpch_q08/duckdb:vortex-file-compressed 1163301315 1205473557 0.97
tpch_q09/duckdb:vortex-file-compressed 1137836979 1032749611 1.10
tpch_q10/duckdb:vortex-file-compressed 952747905 916732358 1.04
tpch_q11/duckdb:vortex-file-compressed 628938507 500242282 1.26
tpch_q12/duckdb:vortex-file-compressed 859638039 742368475 1.16
tpch_q13/duckdb:vortex-file-compressed 520203149 559941109 0.93
tpch_q14/duckdb:vortex-file-compressed 523183717 482608347 1.08
tpch_q15/duckdb:vortex-file-compressed 351461617 364595070 0.96
tpch_q16/duckdb:vortex-file-compressed 380380965 363244973 1.05
tpch_q17/duckdb:vortex-file-compressed 699087336 780521554 0.90
tpch_q18/duckdb:vortex-file-compressed 650278768 641098759 1.01
tpch_q19/duckdb:vortex-file-compressed 504021920 536933275 0.94
tpch_q20/duckdb:vortex-file-compressed 880160776 854942264 1.03
tpch_q21/duckdb:vortex-file-compressed 1162425298 1141497514 1.02
tpch_q22/duckdb:vortex-file-compressed 322215665 307875305 1.05
duckdb / vortex-compact (1.032x ➖, 0↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 315540728 340742316 0.93
tpch_q02/duckdb:vortex-compact 1006956396 980898668 1.03
tpch_q03/duckdb:vortex-compact 757677545 713332889 1.06
tpch_q04/duckdb:vortex-compact 446492709 445817155 1.00
tpch_q05/duckdb:vortex-compact 898094524 934160681 0.96
tpch_q06/duckdb:vortex-compact 432828097 458833092 0.94
tpch_q07/duckdb:vortex-compact 1043519565 1007107277 1.04
tpch_q08/duckdb:vortex-compact 1111636501 990773141 1.12
tpch_q09/duckdb:vortex-compact 1006198544 942198024 1.07
tpch_q10/duckdb:vortex-compact 793789120 738617942 1.07
tpch_q11/duckdb:vortex-compact 548331733 529768206 1.04
tpch_q12/duckdb:vortex-compact 661824227 841885742 0.79
tpch_q13/duckdb:vortex-compact 493815906 509146980 0.97
tpch_q14/duckdb:vortex-compact 518955276 429093247 1.21
tpch_q15/duckdb:vortex-compact 371708523 338609652 1.10
tpch_q16/duckdb:vortex-compact 367016319 341567600 1.07
tpch_q17/duckdb:vortex-compact 825421587 706855518 1.17
tpch_q18/duckdb:vortex-compact 534051771 545061154 0.98
tpch_q19/duckdb:vortex-compact 543726931 533918093 1.02
tpch_q20/duckdb:vortex-compact 830285943 725487476 1.14
tpch_q21/duckdb:vortex-compact 1164899671 1111858991 1.05
tpch_q22/duckdb:vortex-compact 322611551 309502103 1.04
duckdb / parquet (1.007x ➖, 0↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 589716491 541801622 1.09
tpch_q02/duckdb:parquet 1161130465 1187788107 0.98
tpch_q03/duckdb:parquet 1235206411 1183833699 1.04
tpch_q04/duckdb:parquet 743865498 704402367 1.06
tpch_q05/duckdb:parquet 1523464965 1387314649 1.10
tpch_q06/duckdb:parquet 476502459 470546547 1.01
tpch_q07/duckdb:parquet 1396254690 1340882502 1.04
tpch_q08/duckdb:parquet 1793479697 1656802720 1.08
tpch_q09/duckdb:parquet 1662181623 1514647990 1.10
tpch_q10/duckdb:parquet 1373191815 1431974174 0.96
tpch_q11/duckdb:parquet 663782040 818044129 0.81
tpch_q12/duckdb:parquet 833580302 823531816 1.01
tpch_q13/duckdb:parquet 1002301453 975156876 1.03
tpch_q14/duckdb:parquet 835410942 708023165 1.18
tpch_q15/duckdb:parquet 567861791 678220104 0.84
tpch_q16/duckdb:parquet 741273396 677560745 1.09
tpch_q17/duckdb:parquet 772193590 901250617 0.86
tpch_q18/duckdb:parquet 1000444434 985424021 1.02
tpch_q19/duckdb:parquet 886615021 911594778 0.97
tpch_q20/duckdb:parquet 1224599691 1332688845 0.92
tpch_q21/duckdb:parquet 1225631544 1216824756 1.01
tpch_q22/duckdb:parquet 636442466 602545172 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +26.9% +5.7% +20.1% +81.6% ➖ noise
1 datafusion:vortex-file-compressed +5.6% +5.7% -0.1% +70.3% ➖ noise
1 duckdb:vortex-compact -7.4% +5.7% -12.4% +43.1% ➖ noise
1 duckdb:vortex-file-compressed +7.6% +5.7% +1.8% +49.5% ➖ noise
2 datafusion:vortex-compact -1.5% -1.0% -0.5% +43.1% ➖ noise
2 datafusion:vortex-file-compressed -19.0% -1.0% -18.1% +43.1% ➖ noise
2 duckdb:vortex-compact +2.7% -1.0% +3.7% +43.1% ➖ noise
2 duckdb:vortex-file-compressed +2.1% -1.0% +3.1% +43.1% ➖ noise
3 datafusion:vortex-compact +2.3% -20.8% +29.1% +43.1% ➖ noise
3 datafusion:vortex-file-compressed +9.6% -20.8% +38.3% +62.5% ➖ noise
3 duckdb:vortex-compact +6.2% -20.8% +34.0% +43.1% ➖ noise
3 duckdb:vortex-file-compressed -3.5% -20.8% +21.8% +43.1% ➖ noise
4 datafusion:vortex-compact +1.2% -9.1% +11.3% +45.9% ➖ noise
4 datafusion:vortex-file-compressed -40.2% -9.1% -34.2% +43.1% ✅ faster
4 duckdb:vortex-compact +0.2% -9.1% +10.2% +43.1% ➖ noise
4 duckdb:vortex-file-compressed -13.8% -9.1% -5.1% +43.1% ➖ noise
5 datafusion:vortex-compact +13.4% -4.0% +18.2% +43.1% ➖ noise
5 datafusion:vortex-file-compressed -32.4% -4.0% -29.6% +43.1% ➖ noise
5 duckdb:vortex-compact -3.9% -4.0% +0.2% +43.1% ➖ noise
5 duckdb:vortex-file-compressed +12.4% -4.0% +17.1% +43.1% ➖ noise
6 datafusion:vortex-compact -21.5% +1.6% -22.7% +43.1% ➖ noise
6 datafusion:vortex-file-compressed -6.8% +1.6% -8.2% +43.1% ➖ noise
6 duckdb:vortex-compact -5.7% +1.6% -7.1% +43.1% ➖ noise
6 duckdb:vortex-file-compressed -22.8% +1.6% -24.0% +43.1% ➖ noise
7 datafusion:vortex-compact +3.2% +1.1% +2.1% +43.1% ➖ noise
7 datafusion:vortex-file-compressed -12.6% +1.1% -13.6% +43.1% ➖ noise
7 duckdb:vortex-compact +3.6% +1.1% +2.5% +43.1% ➖ noise
7 duckdb:vortex-file-compressed +1.6% +1.1% +0.5% +43.1% ➖ noise
8 datafusion:vortex-compact -12.3% +14.5% -23.4% +43.1% ➖ noise
8 datafusion:vortex-file-compressed -32.4% +14.5% -40.9% +43.1% ✅ faster
8 duckdb:vortex-compact +12.2% +14.5% -2.0% +43.1% ➖ noise
8 duckdb:vortex-file-compressed -3.5% +14.5% -15.7% +43.1% ➖ noise
9 datafusion:vortex-compact +34.1% +33.1% +0.8% +43.1% ➖ noise
9 datafusion:vortex-file-compressed -27.6% +33.1% -45.6% +43.1% ✅ faster
9 duckdb:vortex-compact +6.8% +33.1% -19.8% +43.1% ➖ noise
9 duckdb:vortex-file-compressed +10.2% +33.1% -17.2% +43.1% ➖ noise
10 datafusion:vortex-compact -11.0% +1.8% -12.6% +43.1% ➖ noise
10 datafusion:vortex-file-compressed -32.9% +1.8% -34.1% +43.1% ✅ faster
10 duckdb:vortex-compact +7.5% +1.8% +5.5% +43.1% ➖ noise
10 duckdb:vortex-file-compressed +3.9% +1.8% +2.0% +43.1% ➖ noise
11 datafusion:vortex-compact -22.8% -8.6% -15.6% +43.7% ➖ noise
11 datafusion:vortex-file-compressed -18.3% -8.6% -10.6% +43.1% ➖ noise
11 duckdb:vortex-compact +3.5% -8.6% +13.2% +43.1% ➖ noise
11 duckdb:vortex-file-compressed +25.7% -8.6% +37.5% +43.1% ➖ noise
12 datafusion:vortex-compact +5.6% -17.9% +28.6% +43.1% ➖ noise
12 datafusion:vortex-file-compressed +3.3% -17.9% +25.8% +43.1% ➖ noise
12 duckdb:vortex-compact -21.4% -17.9% -4.3% +43.1% ➖ noise
12 duckdb:vortex-file-compressed +15.8% -17.9% +41.0% +43.1% ➖ noise
13 datafusion:vortex-compact -10.1% -8.9% -1.4% +55.5% ➖ noise
13 datafusion:vortex-file-compressed +11.4% -8.9% +22.3% +49.1% ➖ noise
13 duckdb:vortex-compact -3.0% -8.9% +6.4% +43.1% ➖ noise
13 duckdb:vortex-file-compressed -7.1% -8.9% +1.9% +43.1% ➖ noise
14 datafusion:vortex-compact -24.2% -16.9% -8.8% +45.8% ➖ noise
14 datafusion:vortex-file-compressed -17.9% -16.9% -1.2% +43.1% ➖ noise
14 duckdb:vortex-compact +20.9% -16.9% +45.5% +43.1% 🚨 regression
14 duckdb:vortex-file-compressed +8.4% -16.9% +30.4% +43.1% ➖ noise
15 datafusion:vortex-compact -25.0% -17.9% -8.6% +43.1% ➖ noise
15 datafusion:vortex-file-compressed +24.9% -17.9% +52.1% +43.1% 🚨 regression
15 duckdb:vortex-compact +9.8% -17.9% +33.7% +43.1% ➖ noise
15 duckdb:vortex-file-compressed -3.6% -17.9% +17.4% +43.1% ➖ noise
16 datafusion:vortex-compact +8.8% +20.2% -9.5% +43.1% ➖ noise
16 datafusion:vortex-file-compressed -5.1% +20.2% -21.0% +43.1% ➖ noise
16 duckdb:vortex-compact +7.5% +20.2% -10.6% +43.1% ➖ noise
16 duckdb:vortex-file-compressed +4.7% +20.2% -12.9% +43.1% ➖ noise
17 datafusion:vortex-compact +12.1% -9.5% +23.8% +43.1% ➖ noise
17 datafusion:vortex-file-compressed -1.5% -9.5% +8.8% +43.1% ➖ noise
17 duckdb:vortex-compact +16.8% -9.5% +29.0% +43.1% ➖ noise
17 duckdb:vortex-file-compressed -10.4% -9.5% -1.0% +43.1% ➖ noise
18 datafusion:vortex-compact +11.8% -14.1% +30.2% +43.1% ➖ noise
18 datafusion:vortex-file-compressed +25.8% -14.1% +46.4% +43.1% 🚨 regression
18 duckdb:vortex-compact -2.0% -14.1% +14.0% +43.1% ➖ noise
18 duckdb:vortex-file-compressed +1.4% -14.1% +18.1% +43.1% ➖ noise
19 datafusion:vortex-compact +10.1% +3.6% +6.3% +43.1% ➖ noise
19 datafusion:vortex-file-compressed +7.5% +3.6% +3.8% +43.1% ➖ noise
19 duckdb:vortex-compact +1.8% +3.6% -1.7% +43.1% ➖ noise
19 duckdb:vortex-file-compressed -6.1% +3.6% -9.4% +43.1% ➖ noise
20 datafusion:vortex-compact +8.9% -8.1% +18.5% +43.1% ➖ noise
20 datafusion:vortex-file-compressed -16.7% -8.1% -9.4% +43.1% ➖ noise
20 duckdb:vortex-compact +14.4% -8.1% +24.5% +43.1% ➖ noise
20 duckdb:vortex-file-compressed +2.9% -8.1% +12.0% +43.1% ➖ noise
21 datafusion:vortex-compact +17.3% +10.3% +6.4% +43.1% ➖ noise
21 datafusion:vortex-file-compressed -11.7% +10.3% -20.0% +43.1% ➖ noise
21 duckdb:vortex-compact +4.8% +10.3% -5.0% +43.1% ➖ noise
21 duckdb:vortex-file-compressed +1.8% +10.3% -7.6% +43.1% ➖ noise
22 datafusion:vortex-compact +18.6% +20.2% -1.3% +43.1% ➖ noise
22 datafusion:vortex-file-compressed -32.8% +20.2% -44.1% +48.1% ✅ faster
22 duckdb:vortex-compact +4.2% +20.2% -13.3% +43.1% ➖ noise
22 duckdb:vortex-file-compressed +4.7% +20.2% -12.9% +43.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.2%
Vortex (geomean): 1.027x ➖
Parquet (geomean): 1.026x ➖
Shifts: Parquet (control) +2.6% · Median polish +2.8%


datafusion / vortex-file-compressed (1.005x ➖, 1↑ 2↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 708804721 848337844 0.84
tpch_q02/datafusion:vortex-file-compressed 879091234 1124414170 0.78
tpch_q03/datafusion:vortex-file-compressed 939380433 1137894233 0.83
tpch_q04/datafusion:vortex-file-compressed 584225235 682831110 0.86
tpch_q05/datafusion:vortex-file-compressed 1027576290 1051880574 0.98
tpch_q06/datafusion:vortex-file-compressed 597138799 668431927 0.89
tpch_q07/datafusion:vortex-file-compressed 1130750438 1006886782 1.12
tpch_q08/datafusion:vortex-file-compressed 🚀 1705873766 2442896813 0.70
tpch_q09/datafusion:vortex-file-compressed 1505721753 1466204883 1.03
tpch_q10/datafusion:vortex-file-compressed 1290990007 1172326138 1.10
tpch_q11/datafusion:vortex-file-compressed 604466223 483102164 1.25
tpch_q12/datafusion:vortex-file-compressed 1184340268 954629833 1.24
tpch_q13/datafusion:vortex-file-compressed 481891392 490220615 0.98
tpch_q14/datafusion:vortex-file-compressed 🚨 769874333 570770727 1.35
tpch_q15/datafusion:vortex-file-compressed 1041998497 958681287 1.09
tpch_q16/datafusion:vortex-file-compressed 435339358 374111540 1.16
tpch_q17/datafusion:vortex-file-compressed 1213611424 1195857340 1.01
tpch_q18/datafusion:vortex-file-compressed 1349162093 1413373863 0.95
tpch_q19/datafusion:vortex-file-compressed 1107189827 1093095967 1.01
tpch_q20/datafusion:vortex-file-compressed 🚨 1439326236 1106622139 1.30
tpch_q21/datafusion:vortex-file-compressed 2342160808 2281378771 1.03
tpch_q22/datafusion:vortex-file-compressed 578883548 628646912 0.92
datafusion / vortex-compact (1.050x ➖, 2↑ 5↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 736982216 726087123 1.02
tpch_q02/datafusion:vortex-compact 🚨 1123647982 714580185 1.57
tpch_q03/datafusion:vortex-compact 🚀 810959078 1265594523 0.64
tpch_q04/datafusion:vortex-compact 504952083 662218641 0.76
tpch_q05/datafusion:vortex-compact 877095751 1060263542 0.83
tpch_q06/datafusion:vortex-compact 564156755 705022425 0.80
tpch_q07/datafusion:vortex-compact 1022498006 1116200900 0.92
tpch_q08/datafusion:vortex-compact 1183647668 1193217077 0.99
tpch_q09/datafusion:vortex-compact 1474057925 1368039255 1.08
tpch_q10/datafusion:vortex-compact 959251288 897410232 1.07
tpch_q11/datafusion:vortex-compact 459317281 431170740 1.07
tpch_q12/datafusion:vortex-compact 🚨 1467535555 1045591604 1.40
tpch_q13/datafusion:vortex-compact 543290229 472021274 1.15
tpch_q14/datafusion:vortex-compact 796175324 614815162 1.29
tpch_q15/datafusion:vortex-compact 1214117958 980224095 1.24
tpch_q16/datafusion:vortex-compact 389931291 415346751 0.94
tpch_q17/datafusion:vortex-compact 🚨 1619657196 1170218804 1.38
tpch_q18/datafusion:vortex-compact 🚨 1475167776 1062452624 1.39
tpch_q19/datafusion:vortex-compact 🚨 1194870481 827090625 1.44
tpch_q20/datafusion:vortex-compact 1068051537 839888084 1.27
tpch_q21/datafusion:vortex-compact 1428365271 1575107297 0.91
tpch_q22/datafusion:vortex-compact 🚀 354287630 545631045 0.65
datafusion / parquet (0.939x ➖, 1↑ 2↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 893019622 940440166 0.95
tpch_q02/datafusion:parquet 1124034877 1109497990 1.01
tpch_q03/datafusion:parquet 1147030419 1069799417 1.07
tpch_q04/datafusion:parquet 481957970 504997875 0.95
tpch_q05/datafusion:parquet 1197042504 1272322724 0.94
tpch_q06/datafusion:parquet 541968658 578858310 0.94
tpch_q07/datafusion:parquet 🚨 1783732213 1352560787 1.32
tpch_q08/datafusion:parquet 🚨 2236699920 1633097189 1.37
tpch_q09/datafusion:parquet 2101181346 1870084533 1.12
tpch_q10/datafusion:parquet 2340067198 2806277395 0.83
tpch_q11/datafusion:parquet 679739858 884195661 0.77
tpch_q12/datafusion:parquet 756309191 731087762 1.03
tpch_q13/datafusion:parquet 812571733 1120448185 0.73
tpch_q14/datafusion:parquet 1123389897 1445626527 0.78
tpch_q15/datafusion:parquet 1457398825 1730925106 0.84
tpch_q16/datafusion:parquet 🚀 339290169 579232116 0.59
tpch_q17/datafusion:parquet 1479104405 1380357978 1.07
tpch_q18/datafusion:parquet 1766017086 1842506077 0.96
tpch_q19/datafusion:parquet 971273320 1003888871 0.97
tpch_q20/datafusion:parquet 1400362665 1639000458 0.85
tpch_q21/datafusion:parquet 1866808574 1888681135 0.99
tpch_q22/datafusion:parquet 910497712 994722429 0.92
duckdb / vortex-file-compressed (1.026x ➖, 0↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 715409237 619309192 1.16
tpch_q02/duckdb:vortex-file-compressed 1427169950 1325875328 1.08
tpch_q03/duckdb:vortex-file-compressed 904957095 977635387 0.93
tpch_q04/duckdb:vortex-file-compressed 935793090 746930443 1.25
tpch_q05/duckdb:vortex-file-compressed 1323129002 1310199367 1.01
tpch_q06/duckdb:vortex-file-compressed 616729045 666747740 0.92
tpch_q07/duckdb:vortex-file-compressed 1328158137 1335641058 0.99
tpch_q08/duckdb:vortex-file-compressed 1654900267 1585420668 1.04
tpch_q09/duckdb:vortex-file-compressed 1787893243 1768874083 1.01
tpch_q10/duckdb:vortex-file-compressed 1336702531 1298278656 1.03
tpch_q11/duckdb:vortex-file-compressed 781668772 684290533 1.14
tpch_q12/duckdb:vortex-file-compressed 1274380528 1400545104 0.91
tpch_q13/duckdb:vortex-file-compressed 1041673431 1081060609 0.96
tpch_q14/duckdb:vortex-file-compressed 690609845 663385713 1.04
tpch_q15/duckdb:vortex-file-compressed 540120043 533927311 1.01
tpch_q16/duckdb:vortex-file-compressed 482018666 543199350 0.89
tpch_q17/duckdb:vortex-file-compressed 985284991 954146096 1.03
tpch_q18/duckdb:vortex-file-compressed 1096557345 970976624 1.13
tpch_q19/duckdb:vortex-file-compressed 779770566 806481963 0.97
tpch_q20/duckdb:vortex-file-compressed 1314216056 1191800804 1.10
tpch_q21/duckdb:vortex-file-compressed 2044417097 2121699118 0.96
tpch_q22/duckdb:vortex-file-compressed 536163985 493344104 1.09
duckdb / vortex-compact (1.028x ➖, 0↑ 0↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 635836895 606967736 1.05
tpch_q02/duckdb:vortex-compact 1237803590 1066906018 1.16
tpch_q03/duckdb:vortex-compact 955623226 861606472 1.11
tpch_q04/duckdb:vortex-compact 603558882 656644921 0.92
tpch_q05/duckdb:vortex-compact 1322077283 1194248559 1.11
tpch_q06/duckdb:vortex-compact 567180601 613586555 0.92
tpch_q07/duckdb:vortex-compact 1239211575 1229944214 1.01
tpch_q08/duckdb:vortex-compact 1611738084 1393374289 1.16
tpch_q09/duckdb:vortex-compact 1626207246 1690133988 0.96
tpch_q10/duckdb:vortex-compact 1233007242 1231915243 1.00
tpch_q11/duckdb:vortex-compact 790968083 797463343 0.99
tpch_q12/duckdb:vortex-compact 1116392390 1117727577 1.00
tpch_q13/duckdb:vortex-compact 993065877 857006903 1.16
tpch_q14/duckdb:vortex-compact 702584526 634414712 1.11
tpch_q15/duckdb:vortex-compact 550130874 573734218 0.96
tpch_q16/duckdb:vortex-compact 415962260 461597270 0.90
tpch_q17/duckdb:vortex-compact 1077307266 928041207 1.16
tpch_q18/duckdb:vortex-compact 868396884 806033236 1.08
tpch_q19/duckdb:vortex-compact 749117823 767999390 0.98
tpch_q20/duckdb:vortex-compact 1298526213 1209564912 1.07
tpch_q21/duckdb:vortex-compact 1805931143 1843265104 0.98
tpch_q22/duckdb:vortex-compact 462564699 500183900 0.92
duckdb / parquet (1.121x ➖, 0↑ 2↓)
name PR 340e387 (ns) base f852d72 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 1119830838 857781269 1.31
tpch_q02/duckdb:parquet 1702637944 1402843591 1.21
tpch_q03/duckdb:parquet 2156559348 2060669302 1.05
tpch_q04/duckdb:parquet 1194974601 1132994345 1.05
tpch_q05/duckdb:parquet 2426075460 1989162339 1.22
tpch_q06/duckdb:parquet 816590543 816837505 1.00
tpch_q07/duckdb:parquet 2498072675 1973659752 1.27
tpch_q08/duckdb:parquet 3172029318 2493516556 1.27
tpch_q09/duckdb:parquet 3027798801 2700120192 1.12
tpch_q10/duckdb:parquet 3515558558 3111851460 1.13
tpch_q11/duckdb:parquet 1159817316 1025062950 1.13
tpch_q12/duckdb:parquet 1579956561 1259585916 1.25
tpch_q13/duckdb:parquet 1445359324 1364557546 1.06
tpch_q14/duckdb:parquet 1499507678 1411891604 1.06
tpch_q15/duckdb:parquet 🚨 1264059303 969982796 1.30
tpch_q16/duckdb:parquet 1036852456 1039411689 1.00
tpch_q17/duckdb:parquet 1491744361 1426176327 1.05
tpch_q18/duckdb:parquet 1746306389 1757970915 0.99
tpch_q19/duckdb:parquet 1675219571 1632014625 1.03
tpch_q20/duckdb:parquet 2320562903 1929739847 1.20
tpch_q21/duckdb:parquet 2147309589 1825188498 1.18
tpch_q22/duckdb:parquet 1145866770 1271097820 0.90
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +1.5% +11.3% -8.8% +42.5% ➖ noise
1 datafusion:vortex-file-compressed -16.4% +11.3% -25.0% +55.0% ➖ noise
1 duckdb:vortex-compact +4.8% +11.3% -5.9% +37.1% ➖ noise
1 duckdb:vortex-file-compressed +15.5% +11.3% +3.8% +44.2% ➖ noise
2 datafusion:vortex-compact +57.2% +10.9% +41.8% +41.8% 🚨 regression
2 datafusion:vortex-file-compressed -21.8% +10.9% -29.5% +40.4% ✅ faster
2 duckdb:vortex-compact +16.0% +10.9% +4.6% +37.1% ➖ noise
2 duckdb:vortex-file-compressed +7.6% +10.9% -2.9% +37.1% ➖ noise
3 datafusion:vortex-compact -35.9% +5.9% -39.5% +48.7% ✅ faster
3 datafusion:vortex-file-compressed -17.4% +5.9% -22.1% +53.8% ➖ noise
3 duckdb:vortex-compact +10.9% +5.9% +4.7% +44.5% ➖ noise
3 duckdb:vortex-file-compressed -7.4% +5.9% -12.6% +49.5% ➖ noise
4 datafusion:vortex-compact -23.7% +0.3% -24.0% +37.1% ➖ noise
4 datafusion:vortex-file-compressed -14.4% +0.3% -14.7% +37.1% ➖ noise
4 duckdb:vortex-compact -8.1% +0.3% -8.4% +37.1% ➖ noise
4 duckdb:vortex-file-compressed +25.3% +0.3% +24.9% +37.1% ➖ noise
5 datafusion:vortex-compact -17.3% +7.1% -22.8% +37.1% ➖ noise
5 datafusion:vortex-file-compressed -2.3% +7.1% -8.8% +37.1% ➖ noise
5 duckdb:vortex-compact +10.7% +7.1% +3.3% +37.1% ➖ noise
5 duckdb:vortex-file-compressed +1.0% +7.1% -5.7% +37.1% ➖ noise
6 datafusion:vortex-compact -20.0% -3.3% -17.3% +37.1% ➖ noise
6 datafusion:vortex-file-compressed -10.7% -3.3% -7.7% +37.1% ➖ noise
6 duckdb:vortex-compact -7.6% -3.3% -4.5% +37.1% ➖ noise
6 duckdb:vortex-file-compressed -7.5% -3.3% -4.4% +43.0% ➖ noise
7 datafusion:vortex-compact -8.4% +29.2% -29.1% +37.1% ✅ faster
7 datafusion:vortex-file-compressed +12.3% +29.2% -13.1% +37.1% ➖ noise
7 duckdb:vortex-compact +0.8% +29.2% -22.0% +37.1% ➖ noise
7 duckdb:vortex-file-compressed -0.6% +29.2% -23.0% +37.1% ➖ noise
8 datafusion:vortex-compact -0.8% +32.0% -24.8% +37.1% ➖ noise
8 datafusion:vortex-file-compressed -30.2% +32.0% -47.1% +42.6% ✅ faster
8 duckdb:vortex-compact +15.7% +32.0% -12.4% +37.1% ➖ noise
8 duckdb:vortex-file-compressed +4.4% +32.0% -20.9% +37.1% ➖ noise
9 datafusion:vortex-compact +7.7% +12.2% -4.0% +37.1% ➖ noise
9 datafusion:vortex-file-compressed +2.7% +12.2% -8.5% +37.1% ➖ noise
9 duckdb:vortex-compact -3.8% +12.2% -14.3% +37.1% ➖ noise
9 duckdb:vortex-file-compressed +1.1% +12.2% -10.0% +37.1% ➖ noise
10 datafusion:vortex-compact +6.9% -2.9% +10.1% +37.1% ➖ noise
10 datafusion:vortex-file-compressed +10.1% -2.9% +13.5% +37.1% ➖ noise
10 duckdb:vortex-compact +0.1% -2.9% +3.1% +37.1% ➖ noise
10 duckdb:vortex-file-compressed +3.0% -2.9% +6.1% +37.1% ➖ noise
11 datafusion:vortex-compact +6.5% -6.7% +14.2% +37.1% ➖ noise
11 datafusion:vortex-file-compressed +25.1% -6.7% +34.2% +37.1% ➖ noise
11 duckdb:vortex-compact -0.8% -6.7% +6.3% +37.1% ➖ noise
11 duckdb:vortex-file-compressed +14.2% -6.7% +22.5% +37.1% ➖ noise
12 datafusion:vortex-compact +40.4% +13.9% +23.2% +37.1% ➖ noise
12 datafusion:vortex-file-compressed +24.1% +13.9% +8.9% +37.8% ➖ noise
12 duckdb:vortex-compact -0.1% +13.9% -12.3% +37.1% ➖ noise
12 duckdb:vortex-file-compressed -9.0% +13.9% -20.1% +37.1% ➖ noise
13 datafusion:vortex-compact +15.1% -12.4% +31.3% +37.1% ➖ noise
13 datafusion:vortex-file-compressed -1.7% -12.4% +12.2% +37.1% ➖ noise
13 duckdb:vortex-compact +15.9% -12.4% +32.2% +40.7% ➖ noise
13 duckdb:vortex-file-compressed -3.6% -12.4% +9.9% +40.4% ➖ noise
14 datafusion:vortex-compact +29.5% -9.2% +42.5% +37.1% 🚨 regression
14 datafusion:vortex-file-compressed +34.9% -9.2% +48.5% +37.1% 🚨 regression
14 duckdb:vortex-compact +10.7% -9.2% +21.9% +37.1% ➖ noise
14 duckdb:vortex-file-compressed +4.1% -9.2% +14.6% +37.1% ➖ noise
15 datafusion:vortex-compact +23.9% +4.7% +18.2% +37.1% ➖ noise
15 datafusion:vortex-file-compressed +8.7% +4.7% +3.8% +37.1% ➖ noise
15 duckdb:vortex-compact -4.1% +4.7% -8.5% +37.1% ➖ noise
15 duckdb:vortex-file-compressed +1.2% +4.7% -3.4% +37.1% ➖ noise
16 datafusion:vortex-compact -6.1% -23.6% +22.8% +45.2% ➖ noise
16 datafusion:vortex-file-compressed +16.4% -23.6% +52.2% +37.1% 🚨 regression
16 duckdb:vortex-compact -9.9% -23.6% +17.9% +37.1% ➖ noise
16 duckdb:vortex-file-compressed -11.3% -23.6% +16.1% +37.1% ➖ noise
17 datafusion:vortex-compact +38.4% +5.9% +30.7% +37.1% ➖ noise
17 datafusion:vortex-file-compressed +1.5% +5.9% -4.1% +37.1% ➖ noise
17 duckdb:vortex-compact +16.1% +5.9% +9.6% +37.1% ➖ noise
17 duckdb:vortex-file-compressed +3.3% +5.9% -2.5% +37.1% ➖ noise
18 datafusion:vortex-compact +38.8% -2.4% +42.3% +37.1% 🚨 regression
18 datafusion:vortex-file-compressed -4.5% -2.4% -2.2% +37.1% ➖ noise
18 duckdb:vortex-compact +7.7% -2.4% +10.4% +37.1% ➖ noise
18 duckdb:vortex-file-compressed +12.9% -2.4% +15.7% +37.1% ➖ noise
19 datafusion:vortex-compact +44.5% -0.3% +45.0% +37.1% 🚨 regression
19 datafusion:vortex-file-compressed +1.3% -0.3% +1.6% +48.8% ➖ noise
19 duckdb:vortex-compact -2.5% -0.3% -2.1% +37.1% ➖ noise
19 duckdb:vortex-file-compressed -3.3% -0.3% -3.0% +37.1% ➖ noise
20 datafusion:vortex-compact +27.2% +1.4% +25.5% +37.1% ➖ noise
20 datafusion:vortex-file-compressed +30.1% +1.4% +28.3% +37.1% ➖ noise
20 duckdb:vortex-compact +7.4% +1.4% +5.9% +37.1% ➖ noise
20 duckdb:vortex-file-compressed +10.3% +1.4% +8.8% +37.1% ➖ noise
21 datafusion:vortex-compact -9.3% +7.8% -15.9% +37.1% ➖ noise
21 datafusion:vortex-file-compressed +2.7% +7.8% -4.8% +37.1% ➖ noise
21 duckdb:vortex-compact -2.0% +7.8% -9.1% +37.1% ➖ noise
21 duckdb:vortex-file-compressed -3.6% +7.8% -10.6% +37.1% ➖ noise
22 datafusion:vortex-compact -35.1% -9.2% -28.5% +37.1% ✅ faster
22 datafusion:vortex-file-compressed -7.9% -9.2% +1.4% +37.6% ➖ noise
22 duckdb:vortex-compact -7.5% -9.2% +1.8% +37.1% ➖ noise
22 duckdb:vortex-file-compressed +8.7% -9.2% +19.6% +37.1% ➖ noise

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/chore A trivial change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants