Skip to content

Adamg/remove map fn limit - #8766

Draft
AdamGS wants to merge 1 commit into
developfrom
adamg/remove-map-fn-limit
Draft

Adamg/remove map fn limit#8766
AdamGS wants to merge 1 commit into
developfrom
adamg/remove-map-fn-limit

Conversation

@AdamGS

@AdamGS AdamGS commented Jul 15, 2026

Copy link
Copy Markdown
Contributor

Rationale for this change

Reviving #7565

What changes are included in this PR?

What APIs are changed? Are there any user-facing changes?

@AdamGS
AdamGS force-pushed the adamg/remove-map-fn-limit branch from 112e14e to a684568 Compare July 17, 2026 09:45
@AdamGS
AdamGS force-pushed the adamg/remove-map-fn-limit branch from 882dc6e to eaff866 Compare July 17, 2026 12:39
@AdamGS
AdamGS force-pushed the adamg/remove-map-fn-limit branch from b0b6794 to da0d99c Compare July 17, 2026 14:50
@AdamGS
AdamGS force-pushed the adamg/remove-map-fn-limit branch from 3b330f4 to bf8ba8a Compare July 17, 2026 15:47
@AdamGS
AdamGS force-pushed the adamg/remove-map-fn-limit branch 2 times, most recently from 7015650 to 26a82c5 Compare July 28, 2026 10:35
@AdamGS AdamGS added action/bench-sql Run SQL benchmarks without Vortex Compact on this PR action/benchmark-sql and removed action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Jul 28, 2026
@AdamGS
AdamGS force-pushed the adamg/remove-map-fn-limit branch 2 times, most recently from f1ba9b0 to 01e195e Compare July 29, 2026 16:04
@AdamGS
AdamGS force-pushed the adamg/remove-map-fn-limit branch from 2fbb89b to e8926b6 Compare August 4, 2026 11:20
@AdamGS
AdamGS changed the base branch from develop to adamg/splits-optimization August 4, 2026 11:25
@AdamGS
AdamGS force-pushed the adamg/remove-map-fn-limit branch from e8926b6 to 302e5ac Compare August 4, 2026 13:47
@AdamGS
AdamGS force-pushed the adamg/remove-map-fn-limit branch from 302e5ac to c78c784 Compare August 5, 2026 13:33
Base automatically changed from adamg/splits-optimization to develop August 6, 2026 15:11
@AdamGS
AdamGS force-pushed the adamg/remove-map-fn-limit branch from c78c784 to 4b9c142 Compare August 6, 2026 15:19
@vortex-data vortex-data deleted a comment from github-actions Bot Aug 6, 2026
@vortex-data vortex-data deleted a comment from github-actions Bot Aug 6, 2026
@vortex-data vortex-data deleted a comment from github-actions Bot Aug 6, 2026
@vortex-data vortex-data deleted a comment from github-actions Bot Aug 6, 2026
@vortex-data vortex-data deleted a comment from github-actions Bot Aug 6, 2026
@vortex-data vortex-data deleted a comment from github-actions Bot Aug 6, 2026
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 4547be5 clickbench-nvme 1 Explore Profiling Data
🟢 Done 4547be5 tpch-s3 1 Explore Profiling Data
🟢 Done 4547be5 fineweb-s3 1 Explore Profiling Data
🟢 Done 4547be5 tpch-nvme 1 Explore Profiling Data
🟢 Done 4547be5 tpcds-nvme 1 Explore Profiling Data
🟢 Done 4547be5 polarsignals 1 Explore Profiling Data
🟢 Done 4547be5 statpopgen 1 Explore Profiling Data
🟢 Done 4547be5 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 4547be5 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 4547be5 fineweb 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +5.3%
Engines: DataFusion No clear signal (+4.4%, environment too noisy confidence) · DuckDB No clear signal (+6.1%, low confidence)
Vortex (geomean): 1.045x ➖
Parquet (geomean): 0.993x ➖
Shifts: Parquet (control) -0.7% · Median polish +0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.027x ➖, 0↑ 2↓)
name PR 4547be5 (ns) base 81bbae3 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 8368763 7377066 1.13
fineweb_q01/datafusion:vortex-file-compressed 29736839 28451414 1.05
fineweb_q02/datafusion:vortex-file-compressed 🚨 39217422 33441425 1.17
fineweb_q03/datafusion:vortex-file-compressed 42125950 43566425 0.97
fineweb_q04/datafusion:vortex-file-compressed 206898894 204721350 1.01
fineweb_q05/datafusion:vortex-file-compressed 155494061 155758587 1.00
fineweb_q06/datafusion:vortex-file-compressed 38688922 38107013 1.02
fineweb_q07/datafusion:vortex-file-compressed 37889323 41880021 0.90
fineweb_q08/datafusion:vortex-file-compressed 15430504 15113080 1.02
datafusion / parquet / ns (0.983x ➖, 1↑ 0↓)
name PR 4547be5 (ns) base 81bbae3 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 8636927 10294512 0.84
fineweb_q01/datafusion:parquet 199821341 198078746 1.01
fineweb_q02/datafusion:parquet 196777417 197457434 1.00
fineweb_q03/datafusion:parquet 191319913 191496370 1.00
fineweb_q04/datafusion:parquet 207753784 206784551 1.00
fineweb_q05/datafusion:parquet 204302167 203831808 1.00
fineweb_q06/datafusion:parquet 198413673 200677142 0.99
fineweb_q07/datafusion:parquet 194571260 189701512 1.03
fineweb_q08/datafusion:parquet 189517935 189630580 1.00
duckdb / vortex-file-compressed / ns (1.064x ➖, 1↑ 5↓)
name PR 4547be5 (ns) base 81bbae3 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 4305544 5739821 0.75
fineweb_q01/duckdb:vortex-file-compressed 🚨 47561182 41416318 1.15
fineweb_q02/duckdb:vortex-file-compressed 🚨 53772147 46828278 1.15
fineweb_q03/duckdb:vortex-file-compressed 🚨 79800682 71192430 1.12
fineweb_q04/duckdb:vortex-file-compressed 292427708 299425406 0.98
fineweb_q05/duckdb:vortex-file-compressed 234028391 224322638 1.04
fineweb_q06/duckdb:vortex-file-compressed 🚨 90737888 72576680 1.25
fineweb_q07/duckdb:vortex-file-compressed 80070802 81589070 0.98
fineweb_q08/duckdb:vortex-file-compressed 🚨 40163071 31873499 1.26
duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)
name PR 4547be5 (ns) base 81bbae3 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 36127764 36812170 0.98
fineweb_q01/duckdb:parquet 77479121 78560581 0.99
fineweb_q02/duckdb:parquet 79274880 79129908 1.00
fineweb_q03/duckdb:parquet 207843248 207909940 1.00
fineweb_q04/duckdb:parquet 239902644 227898558 1.05
fineweb_q05/duckdb:parquet 202694624 200980623 1.01
fineweb_q06/duckdb:parquet 143212535 143687340 1.00
fineweb_q07/duckdb:parquet 146047733 144175655 1.01
fineweb_q08/duckdb:parquet 37958266 38406909 0.99

File Size Changes (2 files changed, -46.3% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
sample.vortex 1.0 vortex-compact 1.23 GB 0 B 1.23 GB -100.0%

Totals:

  • vortex-compact: 1.23 GB → 0 B (-100.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (0.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +7.2%
Engines: DataFusion No clear signal (+12.3%, low confidence) · DuckDB No clear signal (+2.3%, low confidence)
Vortex (geomean): 1.065x ➖
Parquet (geomean): 0.994x ➖
Shifts: Parquet (control) -0.6% · Median polish +0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.112x ❌, 0↑ 3↓)
name PR 4547be5 (ns) base d443eab (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:vortex-file-compressed 503162186 468491994 1.07
clickbench-sorted_q24/datafusion:vortex-file-compressed 22029695 22994260 0.96
clickbench-sorted_q26/datafusion:vortex-file-compressed 22096407 23112591 0.96
clickbench-sorted_q36/datafusion:vortex-file-compressed 🚨 57351067 48644525 1.18
clickbench-sorted_q37/datafusion:vortex-file-compressed 🚨 42963800 34475043 1.25
clickbench-sorted_q38/datafusion:vortex-file-compressed 47804804 43537410 1.10
clickbench-sorted_q39/datafusion:vortex-file-compressed 🚨 153775450 88596490 1.74
clickbench-sorted_q40/datafusion:vortex-file-compressed 17029065 17681191 0.96
clickbench-sorted_q41/datafusion:vortex-file-compressed 18100212 17463087 1.04
clickbench-sorted_q42/datafusion:vortex-file-compressed 13682369 13007736 1.05
datafusion / parquet / ns (0.990x ➖, 0↑ 0↓)
name PR 4547be5 (ns) base d443eab (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:parquet 2955628376 2940357305 1.01
clickbench-sorted_q24/datafusion:parquet 37291843 36624465 1.02
clickbench-sorted_q26/datafusion:parquet 31043152 31058532 1.00
clickbench-sorted_q36/datafusion:parquet 185061996 179356411 1.03
clickbench-sorted_q37/datafusion:parquet 104869862 107635410 0.97
clickbench-sorted_q38/datafusion:parquet 157280266 171366276 0.92
clickbench-sorted_q39/datafusion:parquet 316281265 329289641 0.96
clickbench-sorted_q40/datafusion:parquet 66893879 68387033 0.98
clickbench-sorted_q41/datafusion:parquet 61209985 59158831 1.03
clickbench-sorted_q42/datafusion:parquet 36504024 37025804 0.99
duckdb / vortex-file-compressed / ns (1.020x ➖, 0↑ 0↓)
name PR 4547be5 (ns) base d443eab (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:vortex-file-compressed 240287611 229575339 1.05
clickbench-sorted_q24/duckdb:vortex-file-compressed 41848622 39770229 1.05
clickbench-sorted_q26/duckdb:vortex-file-compressed 66935126 63567846 1.05
clickbench-sorted_q36/duckdb:vortex-file-compressed 71115577 69992771 1.02
clickbench-sorted_q37/duckdb:vortex-file-compressed 52067238 52778459 0.99
clickbench-sorted_q38/duckdb:vortex-file-compressed 61422516 64774179 0.95
clickbench-sorted_q39/duckdb:vortex-file-compressed 119285945 115892087 1.03
clickbench-sorted_q40/duckdb:vortex-file-compressed 38817269 36676036 1.06
clickbench-sorted_q41/duckdb:vortex-file-compressed 37267685 36856696 1.01
clickbench-sorted_q42/duckdb:vortex-file-compressed 30707383 30481412 1.01
duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)
name PR 4547be5 (ns) base d443eab (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:parquet 224728683 219637177 1.02
clickbench-sorted_q24/duckdb:parquet 28721402 30292348 0.95
clickbench-sorted_q26/duckdb:parquet 23140791 22466710 1.03
clickbench-sorted_q36/duckdb:parquet 68779167 69292571 0.99
clickbench-sorted_q37/duckdb:parquet 58984758 60162161 0.98
clickbench-sorted_q38/duckdb:parquet 62184278 60957005 1.02
clickbench-sorted_q39/duckdb:parquet 108824104 110739879 0.98
clickbench-sorted_q40/duckdb:parquet 29361941 28965079 1.01
clickbench-sorted_q41/duckdb:parquet 28661718 28449650 1.01
clickbench-sorted_q42/duckdb:parquet 20044643 20404304 0.98

File Size Changes (201 files changed, -42.7% overall, 45↑ 156↓)
File Scale Format Base HEAD Change %
hits_001.vortex 1.0 vortex-file-compressed 189.19 MB 193.45 MB +4.26 MB +2.3%
hits_034.vortex 1.0 vortex-file-compressed 182.13 MB 185.44 MB +3.31 MB +1.8%
hits_027.vortex 1.0 vortex-file-compressed 189.93 MB 192.84 MB +2.91 MB +1.5%
hits_038.vortex 1.0 vortex-file-compressed 190.03 MB 192.35 MB +2.31 MB +1.2%
hits_086.vortex 1.0 vortex-file-compressed 192.27 MB 194.29 MB +2.02 MB +1.1%
hits_050.vortex 1.0 vortex-file-compressed 159.66 MB 161.14 MB +1.47 MB +0.9%
hits_085.vortex 1.0 vortex-file-compressed 198.42 MB 199.86 MB +1.44 MB +0.7%
hits_070.vortex 1.0 vortex-file-compressed 198.92 MB 200.17 MB +1.25 MB +0.6%
hits_019.vortex 1.0 vortex-file-compressed 140.90 MB 141.56 MB +680.51 KB +0.5%
hits_081.vortex 1.0 vortex-file-compressed 199.26 MB 200.17 MB +932.91 KB +0.5%
hits_057.vortex 1.0 vortex-file-compressed 159.91 MB 160.61 MB +710.77 KB +0.4%
hits_033.vortex 1.0 vortex-file-compressed 199.37 MB 200.24 MB +884.74 KB +0.4%
hits_076.vortex 1.0 vortex-file-compressed 160.99 MB 161.53 MB +556.52 KB +0.3%
hits_055.vortex 1.0 vortex-file-compressed 199.48 MB 200.08 MB +622.50 KB +0.3%
hits_066.vortex 1.0 vortex-file-compressed 163.09 MB 163.57 MB +497.56 KB +0.3%
hits_071.vortex 1.0 vortex-file-compressed 140.74 MB 141.06 MB +328.63 KB +0.2%
hits_042.vortex 1.0 vortex-file-compressed 201.58 MB 202.03 MB +465.38 KB +0.2%
hits_088.vortex 1.0 vortex-file-compressed 172.00 MB 172.30 MB +303.09 KB +0.2%
hits_061.vortex 1.0 vortex-file-compressed 160.78 MB 161.00 MB +229.75 KB +0.1%
hits_018.vortex 1.0 vortex-file-compressed 199.50 MB 199.76 MB +267.87 KB +0.1%
hits_080.vortex 1.0 vortex-file-compressed 126.81 MB 126.96 MB +149.89 KB +0.1%
hits_029.vortex 1.0 vortex-file-compressed 200.16 MB 200.36 MB +209.59 KB +0.1%
hits_010.vortex 1.0 vortex-file-compressed 169.29 MB 169.46 MB +177.08 KB +0.1%
hits_077.vortex 1.0 vortex-file-compressed 172.36 MB 172.53 MB +179.77 KB +0.1%
hits_056.vortex 1.0 vortex-file-compressed 135.72 MB 135.84 MB +127.90 KB +0.1%
hits_048.vortex 1.0 vortex-file-compressed 199.66 MB 199.85 MB +186.93 KB +0.1%
hits_021.vortex 1.0 vortex-file-compressed 154.39 MB 154.52 MB +139.88 KB +0.1%
hits_075.vortex 1.0 vortex-file-compressed 189.40 MB 189.56 MB +162.67 KB +0.1%
hits_002.vortex 1.0 vortex-file-compressed 161.10 MB 161.18 MB +80.12 KB +0.0%
hits_062.vortex 1.0 vortex-file-compressed 170.73 MB 170.80 MB +66.66 KB +0.0%
hits_051.vortex 1.0 vortex-file-compressed 172.48 MB 172.53 MB +50.40 KB +0.0%
hits_037.vortex 1.0 vortex-file-compressed 177.23 MB 177.27 MB +49.43 KB +0.0%
hits_043.vortex 1.0 vortex-file-compressed 126.50 MB 126.53 MB +25.01 KB +0.0%
hits_073.vortex 1.0 vortex-file-compressed 172.74 MB 172.76 MB +24.22 KB +0.0%
hits_003.vortex 1.0 vortex-file-compressed 136.51 MB 136.53 MB +18.70 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.02 MB 147.04 MB +19.01 KB +0.0%
hits_036.vortex 1.0 vortex-file-compressed 171.54 MB 171.56 MB +21.30 KB +0.0%
hits_095.vortex 1.0 vortex-file-compressed 154.46 MB 154.48 MB +15.12 KB +0.0%
hits_099.vortex 1.0 vortex-file-compressed 171.29 MB 171.31 MB +13.13 KB +0.0%
hits_060.vortex 1.0 vortex-file-compressed 193.33 MB 193.34 MB +10.75 KB +0.0%
hits_012.vortex 1.0 vortex-file-compressed 191.00 MB 191.01 MB +10.21 KB +0.0%
hits_023.vortex 1.0 vortex-file-compressed 195.42 MB 195.43 MB +9.26 KB +0.0%
hits_098.vortex 1.0 vortex-file-compressed 137.51 MB 137.52 MB +6.42 KB +0.0%
hits_092.vortex 1.0 vortex-file-compressed 199.51 MB 199.52 MB +8.84 KB +0.0%
hits_026.vortex 1.0 vortex-file-compressed 131.53 MB 131.53 MB +5.65 KB +0.0%
hits_030.vortex 1.0 vortex-file-compressed 131.86 MB 131.86 MB 4.30 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.39 MB 126.37 MB 17.29 KB -0.0%
hits_054.vortex 1.0 vortex-file-compressed 147.05 MB 147.02 MB 32.35 KB -0.0%
hits_053.vortex 1.0 vortex-file-compressed 189.98 MB 189.94 MB 48.63 KB -0.0%
hits_097.vortex 1.0 vortex-file-compressed 193.05 MB 193.00 MB 51.66 KB -0.0%
hits_044.vortex 1.0 vortex-file-compressed 199.94 MB 199.88 MB 61.72 KB -0.0%
hits_007.vortex 1.0 vortex-file-compressed 200.23 MB 200.16 MB 63.94 KB -0.0%
hits_025.vortex 1.0 vortex-file-compressed 172.07 MB 172.01 MB 56.00 KB -0.0%
hits_017.vortex 1.0 vortex-file-compressed 146.87 MB 146.82 MB 48.76 KB -0.0%
hits_082.vortex 1.0 vortex-file-compressed 140.04 MB 139.99 MB 49.37 KB -0.0%
hits_022.vortex 1.0 vortex-file-compressed 199.12 MB 199.01 MB 107.62 KB -0.1%
hits_011.vortex 1.0 vortex-file-compressed 199.34 MB 199.24 MB 110.20 KB -0.1%
hits_013.vortex 1.0 vortex-file-compressed 161.24 MB 161.15 MB 92.01 KB -0.1%
hits_064.vortex 1.0 vortex-file-compressed 191.03 MB 190.92 MB 115.41 KB -0.1%
hits_008.vortex 1.0 vortex-file-compressed 140.30 MB 140.22 MB 86.82 KB -0.1%
hits_046.vortex 1.0 vortex-file-compressed 101.29 MB 101.23 MB 65.70 KB -0.1%
hits_032.vortex 1.0 vortex-file-compressed 154.66 MB 154.56 MB 103.66 KB -0.1%
hits_069.vortex 1.0 vortex-file-compressed 142.35 MB 142.26 MB 96.83 KB -0.1%
hits_047.vortex 1.0 vortex-file-compressed 154.45 MB 154.35 MB 106.99 KB -0.1%
hits_031.vortex 1.0 vortex-file-compressed 159.66 MB 159.55 MB 110.66 KB -0.1%
hits_078.vortex 1.0 vortex-file-compressed 131.02 MB 130.92 MB 93.70 KB -0.1%
hits_083.vortex 1.0 vortex-file-compressed 157.21 MB 157.09 MB 126.73 KB -0.1%
hits_035.vortex 1.0 vortex-file-compressed 103.09 MB 103.01 MB 85.63 KB -0.1%
hits_052.vortex 1.0 vortex-file-compressed 131.06 MB 130.95 MB 113.23 KB -0.1%
hits_059.vortex 1.0 vortex-file-compressed 199.11 MB 198.94 MB 178.45 KB -0.1%
hits_020.vortex 1.0 vortex-file-compressed 160.24 MB 160.10 MB 144.96 KB -0.1%
hits_090.vortex 1.0 vortex-file-compressed 192.77 MB 192.58 MB 192.35 KB -0.1%
hits_089.vortex 1.0 vortex-file-compressed 131.61 MB 131.48 MB 132.00 KB -0.1%
hits_074.vortex 1.0 vortex-file-compressed 199.26 MB 199.04 MB 219.60 KB -0.1%
hits_024.vortex 1.0 vortex-file-compressed 160.61 MB 160.44 MB 179.10 KB -0.1%
hits_058.vortex 1.0 vortex-file-compressed 155.26 MB 155.09 MB 177.02 KB -0.1%
hits_068.vortex 1.0 vortex-file-compressed 160.68 MB 160.50 MB 186.92 KB -0.1%
hits_072.vortex 1.0 vortex-file-compressed 102.43 MB 102.31 MB 123.64 KB -0.1%
hits_087.vortex 1.0 vortex-file-compressed 161.14 MB 160.95 MB 198.66 KB -0.1%
hits_039.vortex 1.0 vortex-file-compressed 161.36 MB 161.15 MB 218.31 KB -0.1%
hits_005.vortex 1.0 vortex-file-compressed 167.73 MB 167.48 MB 248.23 KB -0.1%
hits_015.vortex 1.0 vortex-file-compressed 131.42 MB 131.21 MB 222.93 KB -0.2%
hits_079.vortex 1.0 vortex-file-compressed 181.41 MB 181.06 MB 355.84 KB -0.2%
hits_067.vortex 1.0 vortex-file-compressed 132.15 MB 131.87 MB 283.99 KB -0.2%
hits_000.vortex 1.0 vortex-file-compressed 131.66 MB 131.37 MB 298.19 KB -0.2%
hits_016.vortex 1.0 vortex-file-compressed 180.63 MB 180.16 MB 479.33 KB -0.3%
hits_041.vortex 1.0 vortex-file-compressed 131.63 MB 131.28 MB 354.70 KB -0.3%
hits_093.vortex 1.0 vortex-file-compressed 132.12 MB 131.73 MB 400.98 KB -0.3%
hits_084.vortex 1.0 vortex-file-compressed 155.08 MB 154.54 MB 558.38 KB -0.4%
hits_063.vortex 1.0 vortex-file-compressed 132.05 MB 131.59 MB 476.74 KB -0.4%
hits_094.vortex 1.0 vortex-file-compressed 158.99 MB 158.38 MB 632.17 KB -0.4%
hits_004.vortex 1.0 vortex-file-compressed 131.99 MB 131.47 MB 529.60 KB -0.4%
hits_028.vortex 1.0 vortex-file-compressed 152.57 MB 151.90 MB 684.64 KB -0.4%
hits_009.vortex 1.0 vortex-file-compressed 101.78 MB 101.32 MB 466.81 KB -0.4%
hits_014.vortex 1.0 vortex-file-compressed 172.80 MB 172.02 MB 797.27 KB -0.5%
hits_096.vortex 1.0 vortex-file-compressed 199.55 MB 198.63 MB 939.23 KB -0.5%
hits_045.vortex 1.0 vortex-file-compressed 141.00 MB 140.30 MB 713.78 KB -0.5%
hits_040.vortex 1.0 vortex-file-compressed 143.91 MB 143.05 MB 873.41 KB -0.6%
hits_049.vortex 1.0 vortex-file-compressed 192.77 MB 191.47 MB 1.30 MB -0.7%
hits_065.vortex 1.0 vortex-file-compressed 161.26 MB 159.73 MB 1.53 MB -1.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_000.vortex 1.0 vortex-compact 98.89 MB 0 B 98.89 MB -100.0%
hits_001.vortex 1.0 vortex-compact 138.94 MB 0 B 138.94 MB -100.0%
hits_002.vortex 1.0 vortex-compact 124.70 MB 0 B 124.70 MB -100.0%
hits_003.vortex 1.0 vortex-compact 104.44 MB 0 B 104.44 MB -100.0%
hits_004.vortex 1.0 vortex-compact 97.56 MB 0 B 97.56 MB -100.0%
hits_005.vortex 1.0 vortex-compact 115.93 MB 0 B 115.93 MB -100.0%
hits_006.vortex 1.0 vortex-compact 95.90 MB 0 B 95.90 MB -100.0%
hits_007.vortex 1.0 vortex-compact 153.47 MB 0 B 153.47 MB -100.0%
hits_008.vortex 1.0 vortex-compact 105.72 MB 0 B 105.72 MB -100.0%
hits_009.vortex 1.0 vortex-compact 75.23 MB 0 B 75.23 MB -100.0%
hits_010.vortex 1.0 vortex-compact 123.16 MB 0 B 123.16 MB -100.0%
hits_011.vortex 1.0 vortex-compact 152.70 MB 0 B 152.70 MB -100.0%
hits_012.vortex 1.0 vortex-compact 139.97 MB 0 B 139.97 MB -100.0%
hits_013.vortex 1.0 vortex-compact 123.96 MB 0 B 123.96 MB -100.0%
hits_014.vortex 1.0 vortex-compact 133.69 MB 0 B 133.69 MB -100.0%
hits_015.vortex 1.0 vortex-compact 98.80 MB 0 B 98.80 MB -100.0%
hits_016.vortex 1.0 vortex-compact 127.54 MB 0 B 127.54 MB -100.0%
hits_017.vortex 1.0 vortex-compact 111.86 MB 0 B 111.86 MB -100.0%
hits_018.vortex 1.0 vortex-compact 152.94 MB 0 B 152.94 MB -100.0%
hits_019.vortex 1.0 vortex-compact 106.16 MB 0 B 106.16 MB -100.0%
hits_020.vortex 1.0 vortex-compact 111.67 MB 0 B 111.67 MB -100.0%
hits_021.vortex 1.0 vortex-compact 110.63 MB 0 B 110.63 MB -100.0%
hits_022.vortex 1.0 vortex-compact 153.13 MB 0 B 153.13 MB -100.0%
hits_023.vortex 1.0 vortex-compact 142.72 MB 0 B 142.72 MB -100.0%
hits_024.vortex 1.0 vortex-compact 125.18 MB 0 B 125.18 MB -100.0%
hits_025.vortex 1.0 vortex-compact 133.46 MB 0 B 133.46 MB -100.0%
hits_026.vortex 1.0 vortex-compact 98.22 MB 0 B 98.22 MB -100.0%
hits_027.vortex 1.0 vortex-compact 139.38 MB 0 B 139.38 MB -100.0%
hits_028.vortex 1.0 vortex-compact 115.74 MB 0 B 115.74 MB -100.0%
hits_029.vortex 1.0 vortex-compact 153.59 MB 0 B 153.59 MB -100.0%
hits_030.vortex 1.0 vortex-compact 98.41 MB 0 B 98.41 MB -100.0%
hits_031.vortex 1.0 vortex-compact 111.14 MB 0 B 111.14 MB -100.0%
hits_032.vortex 1.0 vortex-compact 110.62 MB 0 B 110.62 MB -100.0%
hits_033.vortex 1.0 vortex-compact 153.40 MB 0 B 153.40 MB -100.0%
hits_034.vortex 1.0 vortex-compact 133.85 MB 0 B 133.85 MB -100.0%
hits_035.vortex 1.0 vortex-compact 75.97 MB 0 B 75.97 MB -100.0%
hits_036.vortex 1.0 vortex-compact 133.15 MB 0 B 133.15 MB -100.0%
hits_037.vortex 1.0 vortex-compact 132.93 MB 0 B 132.93 MB -100.0%
hits_038.vortex 1.0 vortex-compact 138.29 MB 0 B 138.29 MB -100.0%
hits_039.vortex 1.0 vortex-compact 124.24 MB 0 B 124.24 MB -100.0%
hits_040.vortex 1.0 vortex-compact 110.47 MB 0 B 110.47 MB -100.0%
hits_041.vortex 1.0 vortex-compact 98.08 MB 0 B 98.08 MB -100.0%
hits_042.vortex 1.0 vortex-compact 136.27 MB 0 B 136.27 MB -100.0%
hits_043.vortex 1.0 vortex-compact 94.69 MB 0 B 94.69 MB -100.0%
hits_044.vortex 1.0 vortex-compact 153.79 MB 0 B 153.79 MB -100.0%
hits_045.vortex 1.0 vortex-compact 106.15 MB 0 B 106.15 MB -100.0%
hits_046.vortex 1.0 vortex-compact 74.93 MB 0 B 74.93 MB -100.0%
hits_047.vortex 1.0 vortex-compact 110.49 MB 0 B 110.49 MB -100.0%
hits_048.vortex 1.0 vortex-compact 153.30 MB 0 B 153.30 MB -100.0%
hits_049.vortex 1.0 vortex-compact 139.31 MB 0 B 139.31 MB -100.0%
hits_050.vortex 1.0 vortex-compact 125.95 MB 0 B 125.95 MB -100.0%
hits_051.vortex 1.0 vortex-compact 133.93 MB 0 B 133.93 MB -100.0%
hits_052.vortex 1.0 vortex-compact 97.59 MB 0 B 97.59 MB -100.0%
hits_053.vortex 1.0 vortex-compact 138.47 MB 0 B 138.47 MB -100.0%
hits_054.vortex 1.0 vortex-compact 112.18 MB 0 B 112.18 MB -100.0%
hits_055.vortex 1.0 vortex-compact 153.31 MB 0 B 153.31 MB -100.0%
hits_056.vortex 1.0 vortex-compact 101.35 MB 0 B 101.35 MB -100.0%
hits_057.vortex 1.0 vortex-compact 111.95 MB 0 B 111.95 MB -100.0%
hits_058.vortex 1.0 vortex-compact 111.43 MB 0 B 111.43 MB -100.0%
hits_059.vortex 1.0 vortex-compact 152.85 MB 0 B 152.85 MB -100.0%
hits_060.vortex 1.0 vortex-compact 141.24 MB 0 B 141.24 MB -100.0%
hits_061.vortex 1.0 vortex-compact 124.61 MB 0 B 124.61 MB -100.0%
hits_062.vortex 1.0 vortex-compact 132.59 MB 0 B 132.59 MB -100.0%
hits_063.vortex 1.0 vortex-compact 99.10 MB 0 B 99.10 MB -100.0%
hits_064.vortex 1.0 vortex-compact 140.00 MB 0 B 140.00 MB -100.0%
hits_065.vortex 1.0 vortex-compact 125.40 MB 0 B 125.40 MB -100.0%
hits_066.vortex 1.0 vortex-compact 117.37 MB 0 B 117.37 MB -100.0%
hits_067.vortex 1.0 vortex-compact 99.19 MB 0 B 99.19 MB -100.0%
hits_068.vortex 1.0 vortex-compact 112.39 MB 0 B 112.39 MB -100.0%
hits_069.vortex 1.0 vortex-compact 99.77 MB 0 B 99.77 MB -100.0%
hits_070.vortex 1.0 vortex-compact 153.48 MB 0 B 153.48 MB -100.0%
hits_071.vortex 1.0 vortex-compact 106.20 MB 0 B 106.20 MB -100.0%
hits_072.vortex 1.0 vortex-compact 75.64 MB 0 B 75.64 MB -100.0%
hits_073.vortex 1.0 vortex-compact 134.18 MB 0 B 134.18 MB -100.0%
hits_074.vortex 1.0 vortex-compact 153.07 MB 0 B 153.07 MB -100.0%
hits_075.vortex 1.0 vortex-compact 137.72 MB 0 B 137.72 MB -100.0%
hits_076.vortex 1.0 vortex-compact 125.62 MB 0 B 125.62 MB -100.0%
hits_077.vortex 1.0 vortex-compact 134.86 MB 0 B 134.86 MB -100.0%
hits_078.vortex 1.0 vortex-compact 97.91 MB 0 B 97.91 MB -100.0%
hits_079.vortex 1.0 vortex-compact 127.97 MB 0 B 127.97 MB -100.0%
hits_080.vortex 1.0 vortex-compact 96.83 MB 0 B 96.83 MB -100.0%
hits_081.vortex 1.0 vortex-compact 153.69 MB 0 B 153.69 MB -100.0%
hits_082.vortex 1.0 vortex-compact 106.24 MB 0 B 106.24 MB -100.0%
hits_083.vortex 1.0 vortex-compact 110.08 MB 0 B 110.08 MB -100.0%
hits_084.vortex 1.0 vortex-compact 110.69 MB 0 B 110.69 MB -100.0%
hits_085.vortex 1.0 vortex-compact 153.23 MB 0 B 153.23 MB -100.0%
hits_086.vortex 1.0 vortex-compact 139.55 MB 0 B 139.55 MB -100.0%
hits_087.vortex 1.0 vortex-compact 125.24 MB 0 B 125.24 MB -100.0%
hits_088.vortex 1.0 vortex-compact 134.22 MB 0 B 134.22 MB -100.0%
hits_089.vortex 1.0 vortex-compact 98.85 MB 0 B 98.85 MB -100.0%
hits_090.vortex 1.0 vortex-compact 141.39 MB 0 B 141.39 MB -100.0%
hits_091.vortex 1.0 vortex-compact 112.59 MB 0 B 112.59 MB -100.0%
hits_092.vortex 1.0 vortex-compact 153.53 MB 0 B 153.53 MB -100.0%
hits_093.vortex 1.0 vortex-compact 98.84 MB 0 B 98.84 MB -100.0%
hits_094.vortex 1.0 vortex-compact 110.72 MB 0 B 110.72 MB -100.0%
hits_095.vortex 1.0 vortex-compact 110.62 MB 0 B 110.62 MB -100.0%
hits_096.vortex 1.0 vortex-compact 153.17 MB 0 B 153.17 MB -100.0%
hits_097.vortex 1.0 vortex-compact 141.42 MB 0 B 141.42 MB -100.0%
hits_098.vortex 1.0 vortex-compact 102.75 MB 0 B 102.75 MB -100.0%
hits_099.vortex 1.0 vortex-compact 133.16 MB 0 B 133.16 MB -100.0%

Totals:

  • vortex-compact: 11.93 GB → 0 B (-100.0%)
  • vortex-file-compressed: 15.96 GB → 15.97 GB (+0.1%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (+1.0%, low confidence) · DuckDB No clear signal (-1.7%, low confidence)
Vortex (geomean): 0.996x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 1↓)
name PR 4547be5 (ns) base be332fc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 301275215 321356298 0.94
tpch_q02/datafusion:vortex-file-compressed 109296061 100510385 1.09
tpch_q03/datafusion:vortex-file-compressed 160481146 157126038 1.02
tpch_q04/datafusion:vortex-file-compressed 67722982 72879307 0.93
tpch_q05/datafusion:vortex-file-compressed 276629705 276377837 1.00
tpch_q06/datafusion:vortex-file-compressed 25838405 27126321 0.95
tpch_q07/datafusion:vortex-file-compressed 367375547 367883922 1.00
tpch_q08/datafusion:vortex-file-compressed 290880505 290270544 1.00
tpch_q09/datafusion:vortex-file-compressed 471658041 483813183 0.97
tpch_q10/datafusion:vortex-file-compressed 181452748 188185055 0.96
tpch_q11/datafusion:vortex-file-compressed 74067711 81384979 0.91
tpch_q12/datafusion:vortex-file-compressed 83396597 85460016 0.98
tpch_q13/datafusion:vortex-file-compressed 117086410 118599154 0.99
tpch_q14/datafusion:vortex-file-compressed 42785398 41354515 1.03
tpch_q15/datafusion:vortex-file-compressed 🚨 83457640 73901818 1.13
tpch_q16/datafusion:vortex-file-compressed 67323452 70724171 0.95
tpch_q17/datafusion:vortex-file-compressed 428197443 420423417 1.02
tpch_q18/datafusion:vortex-file-compressed 626975453 634441393 0.99
tpch_q19/datafusion:vortex-file-compressed 62819797 62455500 1.01
tpch_q20/datafusion:vortex-file-compressed 142817359 139675864 1.02
tpch_q21/datafusion:vortex-file-compressed 491797768 481256475 1.02
tpch_q22/datafusion:vortex-file-compressed 41255316 41217550 1.00
datafusion / parquet / ns (0.985x ➖, 0↑ 0↓)
name PR 4547be5 (ns) base be332fc (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 324165346 323902731 1.00
tpch_q02/datafusion:parquet 220380999 223991602 0.98
tpch_q03/datafusion:parquet 233555158 230693364 1.01
tpch_q04/datafusion:parquet 101119146 99270506 1.02
tpch_q05/datafusion:parquet 360153808 362307952 0.99
tpch_q06/datafusion:parquet 78417169 75752855 1.04
tpch_q07/datafusion:parquet 513785267 531994715 0.97
tpch_q08/datafusion:parquet 403450777 411474664 0.98
tpch_q09/datafusion:parquet 659408047 670017749 0.98
tpch_q10/datafusion:parquet 547596440 553150252 0.99
tpch_q11/datafusion:parquet 150460736 160839182 0.94
tpch_q12/datafusion:parquet 148470526 154925876 0.96
tpch_q13/datafusion:parquet 354206820 353171974 1.00
tpch_q14/datafusion:parquet 118350241 118951800 0.99
tpch_q15/datafusion:parquet 188188776 194380229 0.97
tpch_q16/datafusion:parquet 140606582 144117170 0.98
tpch_q17/datafusion:parquet 505646878 509396158 0.99
tpch_q18/datafusion:parquet 714921036 711283092 1.01
tpch_q19/datafusion:parquet 191236475 193922044 0.99
tpch_q20/datafusion:parquet 302375615 308224461 0.98
tpch_q21/datafusion:parquet 536159127 547761795 0.98
tpch_q22/datafusion:parquet 258326217 278277722 0.93
duckdb / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name PR 4547be5 (ns) base be332fc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 88635497 88347692 1.00
tpch_q02/duckdb:vortex-file-compressed 72886071 71077692 1.03
tpch_q03/duckdb:vortex-file-compressed 135674793 140314030 0.97
tpch_q04/duckdb:vortex-file-compressed 164864134 164529070 1.00
tpch_q05/duckdb:vortex-file-compressed 148812293 152336443 0.98
tpch_q06/duckdb:vortex-file-compressed 39539738 38194121 1.04
tpch_q07/duckdb:vortex-file-compressed 137240939 135542865 1.01
tpch_q08/duckdb:vortex-file-compressed 185871271 179719633 1.03
tpch_q09/duckdb:vortex-file-compressed 295623386 306151846 0.97
tpch_q10/duckdb:vortex-file-compressed 224734766 221299832 1.02
tpch_q11/duckdb:vortex-file-compressed 40918680 40863512 1.00
tpch_q12/duckdb:vortex-file-compressed 113735776 116244086 0.98
tpch_q13/duckdb:vortex-file-compressed 168905426 171876178 0.98
tpch_q14/duckdb:vortex-file-compressed 59633645 60040531 0.99
tpch_q15/duckdb:vortex-file-compressed 91430004 89021347 1.03
tpch_q16/duckdb:vortex-file-compressed 83713793 85906736 0.97
tpch_q17/duckdb:vortex-file-compressed 104730638 108235652 0.97
tpch_q18/duckdb:vortex-file-compressed 260491486 258602620 1.01
tpch_q19/duckdb:vortex-file-compressed 82978830 84727374 0.98
tpch_q20/duckdb:vortex-file-compressed 147201178 147985361 0.99
tpch_q21/duckdb:vortex-file-compressed 492060998 484719381 1.02
tpch_q22/duckdb:vortex-file-compressed 75793541 76797775 0.99
duckdb / parquet / ns (1.014x ➖, 0↑ 1↓)
name PR 4547be5 (ns) base be332fc (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 142220995 115884749 1.23
tpch_q02/duckdb:parquet 103569032 101875481 1.02
tpch_q03/duckdb:parquet 162421804 165581569 0.98
tpch_q04/duckdb:parquet 119254646 116550246 1.02
tpch_q05/duckdb:parquet 187887638 185473266 1.01
tpch_q06/duckdb:parquet 58098803 56276166 1.03
tpch_q07/duckdb:parquet 142114162 144269957 0.99
tpch_q08/duckdb:parquet 219691283 211618475 1.04
tpch_q09/duckdb:parquet 347601615 349058471 1.00
tpch_q10/duckdb:parquet 657226023 648330637 1.01
tpch_q11/duckdb:parquet 41874626 41383228 1.01
tpch_q12/duckdb:parquet 117505658 115688258 1.02
tpch_q13/duckdb:parquet 397943923 396446486 1.00
tpch_q14/duckdb:parquet 152798993 151476586 1.01
tpch_q15/duckdb:parquet 76532527 76634563 1.00
tpch_q16/duckdb:parquet 153480486 154754180 0.99
tpch_q17/duckdb:parquet 113809400 117251328 0.97
tpch_q18/duckdb:parquet 283673414 293787969 0.97
tpch_q19/duckdb:parquet 231717950 225511400 1.03
tpch_q20/duckdb:parquet 197083563 194887856 1.01
tpch_q21/duckdb:parquet 438702518 437285749 1.00
tpch_q22/duckdb:parquet 335935597 336104594 1.00

File Size Changes (9 files changed, -44.0% overall, 0↑ 9↓)
File Scale Format Base HEAD Change %
customer.vortex 10.0 vortex-compact 74.00 MB 0 B 74.00 MB -100.0%
duckdb.db 10.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem.vortex 10.0 vortex-compact 1.28 GB 0 B 1.28 GB -100.0%
nation.vortex 10.0 vortex-compact 8.04 KB 0 B 8.04 KB -100.0%
orders.vortex 10.0 vortex-compact 344.31 MB 0 B 344.31 MB -100.0%
part.vortex 10.0 vortex-compact 35.89 MB 0 B 35.89 MB -100.0%
partsupp.vortex 10.0 vortex-compact 203.66 MB 0 B 203.66 MB -100.0%
region.vortex 10.0 vortex-compact 6.09 KB 0 B 6.09 KB -100.0%
supplier.vortex 10.0 vortex-compact 4.73 MB 0 B 4.73 MB -100.0%

Totals:

  • vortex-compact: 1.92 GB → 0 B (-100.0%)
  • vortex-file-compressed: 2.45 GB → 2.45 GB (0.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +6.4%
Engines: DuckDB No clear signal (+6.4%, low confidence)
Vortex (geomean): 1.061x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish +2.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

duckdb / vortex-file-compressed / ns (1.061x ➖, 1↑ 3↓)
name PR 4547be5 (ns) base 81bbae3 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 🚨 17971302 13727044 1.31
statpopgen_q01/duckdb:vortex-file-compressed 🚀 13096871 14803732 0.88
statpopgen_q02/duckdb:vortex-file-compressed 559371104 597459486 0.94
statpopgen_q03/duckdb:vortex-file-compressed 1278021901 1221783022 1.05
statpopgen_q04/duckdb:vortex-file-compressed 1294250610 1225130948 1.06
statpopgen_q05/duckdb:vortex-file-compressed 🚨 658609856 556507133 1.18
statpopgen_q06/duckdb:vortex-file-compressed 1852920292 1760159103 1.05
statpopgen_q07/duckdb:vortex-file-compressed 266214413 248518730 1.07
statpopgen_q08/duckdb:vortex-file-compressed 280447749 299815265 0.94
statpopgen_q09/duckdb:vortex-file-compressed 983767359 1032193057 0.95
statpopgen_q10/duckdb:vortex-file-compressed 🚨 4229648295 3146513748 1.34
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name PR 4547be5 (ns) base 81bbae3 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 374371241 376152611 1.00
statpopgen_q01/duckdb:parquet 466874144 468749531 1.00
statpopgen_q02/duckdb:parquet 774781161 775090349 1.00
statpopgen_q03/duckdb:parquet 1063288884 1052740438 1.01
statpopgen_q04/duckdb:parquet 1058237671 1051265920 1.01
statpopgen_q05/duckdb:parquet 765792021 774326646 0.99
statpopgen_q06/duckdb:parquet 1023227695 1025889390 1.00
statpopgen_q07/duckdb:parquet 947804363 952727725 0.99
statpopgen_q08/duckdb:parquet 960750124 978718642 0.98
statpopgen_q09/duckdb:parquet 1001346183 1006200506 1.00
statpopgen_q10/duckdb:parquet 1650540753 1647894178 1.00

File Size Changes (2 files changed, -32.3% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 100000 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 960.66 MB 0 B 960.66 MB -100.0%

Totals:

  • vortex-compact: 960.92 MB → 0 B (-100.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (0.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Vortex (geomean): 1.188x ❌


datafusion / vortex-file-compressed / ns (1.188x ❌, 0↑ 4↓)
name PR 4547be5 (ns) base 0f0390a (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 🚨 202548658 131428558 1.54
polarsignals_q01/datafusion:vortex-file-compressed 🚨 268335929 160981260 1.67
polarsignals_q02/datafusion:vortex-file-compressed 20776505 20669324 1.01
polarsignals_q03/datafusion:vortex-file-compressed 🚨 269154597 161652059 1.67
polarsignals_q04/datafusion:vortex-file-compressed 10936705 11635133 0.94
polarsignals_q05/datafusion:vortex-file-compressed 14557287 13869343 1.05
polarsignals_q06/datafusion:vortex-file-compressed 24498232 22383890 1.09
polarsignals_q07/datafusion:vortex-file-compressed 12036359 11970648 1.01
polarsignals_q08/datafusion:vortex-file-compressed 🚨 357569825 269373709 1.33
polarsignals_q09/datafusion:vortex-file-compressed 11556810 12746320 0.91

No file size changes detected.

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.6%
Engines: DataFusion No clear signal (+6.3%, low confidence) · DuckDB No clear signal (-1.0%, low confidence)
Vortex (geomean): 1.020x ➖
Parquet (geomean): 0.994x ➖
Shifts: Parquet (control) -0.6% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.050x ➖, 0↑ 3↓)
name PR 4547be5 (ns) base 74a2b86 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 43506886 43450376 1.00
tpch_q02/datafusion:vortex-file-compressed 23166798 23062407 1.00
tpch_q03/datafusion:vortex-file-compressed 30567330 30010218 1.02
tpch_q04/datafusion:vortex-file-compressed 15532375 15780204 0.98
tpch_q05/datafusion:vortex-file-compressed 49678797 49821796 1.00
tpch_q06/datafusion:vortex-file-compressed 8530791 8420472 1.01
tpch_q07/datafusion:vortex-file-compressed 57334878 56353896 1.02
tpch_q08/datafusion:vortex-file-compressed 45661271 45410107 1.01
tpch_q09/datafusion:vortex-file-compressed 56567703 56975135 0.99
tpch_q10/datafusion:vortex-file-compressed 🚨 41111934 29051248 1.42
tpch_q11/datafusion:vortex-file-compressed 17447112 17251335 1.01
tpch_q12/datafusion:vortex-file-compressed 27170648 27396120 0.99
tpch_q13/datafusion:vortex-file-compressed 24818114 25779167 0.96
tpch_q14/datafusion:vortex-file-compressed 🚨 16416939 14512450 1.13
tpch_q15/datafusion:vortex-file-compressed 21360386 20544599 1.04
tpch_q16/datafusion:vortex-file-compressed 24724908 24129198 1.02
tpch_q17/datafusion:vortex-file-compressed 56366099 55227412 1.02
tpch_q18/datafusion:vortex-file-compressed 71861562 66870078 1.07
tpch_q19/datafusion:vortex-file-compressed 19067279 18688430 1.02
tpch_q20/datafusion:vortex-file-compressed 31803631 31040801 1.02
tpch_q21/datafusion:vortex-file-compressed 62513346 61443346 1.02
tpch_q22/datafusion:vortex-file-compressed 🚨 17948037 12241639 1.47
datafusion / parquet / ns (0.987x ➖, 1↑ 0↓)
name PR 4547be5 (ns) base 74a2b86 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 110496593 114080689 0.97
tpch_q02/datafusion:parquet 70948526 71040990 1.00
tpch_q03/datafusion:parquet 105256723 98562878 1.07
tpch_q04/datafusion:parquet 50105067 50064568 1.00
tpch_q05/datafusion:parquet 🚀 113617791 128407780 0.88
tpch_q06/datafusion:parquet 40311746 40940956 0.98
tpch_q07/datafusion:parquet 132006967 129205800 1.02
tpch_q08/datafusion:parquet 121798030 123628424 0.99
tpch_q09/datafusion:parquet 155628640 160385420 0.97
tpch_q10/datafusion:parquet 119187900 127432632 0.94
tpch_q11/datafusion:parquet 51149143 49860576 1.03
tpch_q12/datafusion:parquet 102530796 103974974 0.99
tpch_q13/datafusion:parquet 225399028 226970962 0.99
tpch_q14/datafusion:parquet 48308522 49092329 0.98
tpch_q15/datafusion:parquet 70475629 71759648 0.98
tpch_q16/datafusion:parquet 51368589 49517911 1.04
tpch_q17/datafusion:parquet 152901749 162817913 0.94
tpch_q18/datafusion:parquet 180510114 183718529 0.98
tpch_q19/datafusion:parquet 78266783 77003997 1.02
tpch_q20/datafusion:parquet 94406944 90896636 1.04
tpch_q21/datafusion:parquet 166287078 165097837 1.01
tpch_q22/datafusion:parquet 54673367 58629752 0.93
duckdb / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)
name PR 4547be5 (ns) base 74a2b86 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 23776032 24057230 0.99
tpch_q02/duckdb:vortex-file-compressed 35643344 36163143 0.99
tpch_q03/duckdb:vortex-file-compressed 39562690 39067439 1.01
tpch_q04/duckdb:vortex-file-compressed 34584922 32503932 1.06
tpch_q05/duckdb:vortex-file-compressed 44950879 44799883 1.00
tpch_q06/duckdb:vortex-file-compressed 12279639 12883348 0.95
tpch_q07/duckdb:vortex-file-compressed 44536207 46198917 0.96
tpch_q08/duckdb:vortex-file-compressed 53825369 53955133 1.00
tpch_q09/duckdb:vortex-file-compressed 62290599 62800057 0.99
tpch_q10/duckdb:vortex-file-compressed 54307647 55860380 0.97
tpch_q11/duckdb:vortex-file-compressed 18640453 19095041 0.98
tpch_q12/duckdb:vortex-file-compressed 31142863 31732272 0.98
tpch_q13/duckdb:vortex-file-compressed 48935524 48524335 1.01
tpch_q14/duckdb:vortex-file-compressed 22910963 22192308 1.03
tpch_q15/duckdb:vortex-file-compressed 20357513 21930938 0.93
tpch_q16/duckdb:vortex-file-compressed 32936134 33065891 1.00
tpch_q17/duckdb:vortex-file-compressed 34304982 34919501 0.98
tpch_q18/duckdb:vortex-file-compressed 52322303 54179431 0.97
tpch_q19/duckdb:vortex-file-compressed 38702262 40242872 0.96
tpch_q20/duckdb:vortex-file-compressed 41606725 39801485 1.05
tpch_q21/duckdb:vortex-file-compressed 124427222 127525650 0.98
tpch_q22/duckdb:vortex-file-compressed 22655532 22286522 1.02
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name PR 4547be5 (ns) base 74a2b86 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 81701650 81537124 1.00
tpch_q02/duckdb:parquet 46203439 45806852 1.01
tpch_q03/duckdb:parquet 80753314 81104808 1.00
tpch_q04/duckdb:parquet 57975090 57721455 1.00
tpch_q05/duckdb:parquet 78373718 78632820 1.00
tpch_q06/duckdb:parquet 25139408 24704714 1.02
tpch_q07/duckdb:parquet 79630255 79466247 1.00
tpch_q08/duckdb:parquet 95928876 98104160 0.98
tpch_q09/duckdb:parquet 148342139 147897042 1.00
tpch_q10/duckdb:parquet 142242982 141247265 1.01
tpch_q11/duckdb:parquet 25139331 25040241 1.00
tpch_q12/duckdb:parquet 53342800 53089698 1.00
tpch_q13/duckdb:parquet 288564630 286308719 1.01
tpch_q14/duckdb:parquet 56027807 55836559 1.00
tpch_q15/duckdb:parquet 30675436 30699601 1.00
tpch_q16/duckdb:parquet 66898361 66929270 1.00
tpch_q17/duckdb:parquet 58092006 58807125 0.99
tpch_q18/duckdb:parquet 127323894 128589545 0.99
tpch_q19/duckdb:parquet 77714358 77571636 1.00
tpch_q20/duckdb:parquet 77306468 77236518 1.00
tpch_q21/duckdb:parquet 188268596 188937392 1.00
tpch_q22/duckdb:parquet 63772264 63553601 1.00

File Size Changes (9 files changed, -43.9% overall, 0↑ 9↓)
File Scale Format Base HEAD Change %
customer.vortex 1.0 vortex-compact 7.40 MB 0 B 7.40 MB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem.vortex 1.0 vortex-compact 126.00 MB 0 B 126.00 MB -100.0%
nation.vortex 1.0 vortex-compact 8.04 KB 0 B 8.04 KB -100.0%
orders.vortex 1.0 vortex-compact 31.73 MB 0 B 31.73 MB -100.0%
part.vortex 1.0 vortex-compact 3.55 MB 0 B 3.55 MB -100.0%
partsupp.vortex 1.0 vortex-compact 20.29 MB 0 B 20.29 MB -100.0%
region.vortex 1.0 vortex-compact 6.09 KB 0 B 6.09 KB -100.0%
supplier.vortex 1.0 vortex-compact 496.71 KB 0 B 496.71 KB -100.0%

Totals:

  • vortex-compact: 189.73 MB → 0 B (-100.0%)
  • vortex-file-compressed: 242.85 MB → 242.85 MB (0.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.0%
Engines: DataFusion No clear signal (+3.3%, low confidence) · DuckDB No clear signal (+0.7%, environment too noisy confidence)
Vortex (geomean): 1.019x ➖
Parquet (geomean): 1.000x ➖
Shifts: Parquet (control) -0.0% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.033x ➖, 1↑ 15↓)
name PR 4547be5 (ns) base be332fc (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 29253833 28083127 1.04
tpcds_q02/datafusion:vortex-file-compressed 52535105 51624165 1.02
tpcds_q03/datafusion:vortex-file-compressed 14024772 14045095 1.00
tpcds_q04/datafusion:vortex-file-compressed 🚨 238810450 212712692 1.12
tpcds_q05/datafusion:vortex-file-compressed 65821404 66886408 0.98
tpcds_q06/datafusion:vortex-file-compressed 26377894 26252268 1.00
tpcds_q07/datafusion:vortex-file-compressed 42792230 43262073 0.99
tpcds_q08/datafusion:vortex-file-compressed 33682844 33638684 1.00
tpcds_q09/datafusion:vortex-file-compressed 27175014 27634242 0.98
tpcds_q10/datafusion:vortex-file-compressed 🚨 55130081 37007143 1.49
tpcds_q11/datafusion:vortex-file-compressed 🚨 131695257 116123483 1.13
tpcds_q12/datafusion:vortex-file-compressed 20481737 20432134 1.00
tpcds_q13/datafusion:vortex-file-compressed 🚨 50805290 44617844 1.14
tpcds_q14/datafusion:vortex-file-compressed 220163647 202227367 1.09
tpcds_q15/datafusion:vortex-file-compressed 28472106 29317296 0.97
tpcds_q16/datafusion:vortex-file-compressed 23950716 24168577 0.99
tpcds_q17/datafusion:vortex-file-compressed 72213078 71365446 1.01
tpcds_q18/datafusion:vortex-file-compressed 89419342 90032086 0.99
tpcds_q19/datafusion:vortex-file-compressed 21658222 21442624 1.01
tpcds_q20/datafusion:vortex-file-compressed 🚨 24775068 21380260 1.16
tpcds_q21/datafusion:vortex-file-compressed 33619736 32581027 1.03
tpcds_q22/datafusion:vortex-file-compressed 🚀 112040068 135217535 0.83
tpcds_q23/datafusion:vortex-file-compressed 140138823 130571160 1.07
tpcds_q24/datafusion:vortex-file-compressed 96835841 97625926 0.99
tpcds_q25/datafusion:vortex-file-compressed 74465618 72793899 1.02
tpcds_q26/datafusion:vortex-file-compressed 37139790 36936590 1.01
tpcds_q27/datafusion:vortex-file-compressed 96057488 91705826 1.05
tpcds_q28/datafusion:vortex-file-compressed 28263045 27938548 1.01
tpcds_q29/datafusion:vortex-file-compressed 69924079 69186790 1.01
tpcds_q30/datafusion:vortex-file-compressed 🚨 36107729 29963931 1.21
tpcds_q31/datafusion:vortex-file-compressed 76825512 76277211 1.01
tpcds_q32/datafusion:vortex-file-compressed 18567794 17992624 1.03
tpcds_q33/datafusion:vortex-file-compressed 32153501 32082271 1.00
tpcds_q34/datafusion:vortex-file-compressed 25948521 27198228 0.95
tpcds_q35/datafusion:vortex-file-compressed 🚨 60870150 44337542 1.37
tpcds_q36/datafusion:vortex-file-compressed 65020647 66233618 0.98
tpcds_q37/datafusion:vortex-file-compressed 18633164 18662464 1.00
tpcds_q38/datafusion:vortex-file-compressed 39571151 39305141 1.01
tpcds_q39/datafusion:vortex-file-compressed 102264460 97583891 1.05
tpcds_q40/datafusion:vortex-file-compressed 35967720 33824099 1.06
tpcds_q41/datafusion:vortex-file-compressed 24170151 24389670 0.99
tpcds_q42/datafusion:vortex-file-compressed 13529511 13515639 1.00
tpcds_q43/datafusion:vortex-file-compressed 19399500 18963061 1.02
tpcds_q44/datafusion:vortex-file-compressed 35837782 35018852 1.02
tpcds_q45/datafusion:vortex-file-compressed 33287092 32833014 1.01
tpcds_q46/datafusion:vortex-file-compressed 34367723 34053797 1.01
tpcds_q47/datafusion:vortex-file-compressed 130745524 127772603 1.02
tpcds_q48/datafusion:vortex-file-compressed 🚨 44305043 38414584 1.15
tpcds_q49/datafusion:vortex-file-compressed 72244041 71417954 1.01
tpcds_q50/datafusion:vortex-file-compressed 49325801 46089902 1.07
tpcds_q51/datafusion:vortex-file-compressed 77620513 75516152 1.03
tpcds_q52/datafusion:vortex-file-compressed 14091416 13830376 1.02
tpcds_q53/datafusion:vortex-file-compressed 24237953 23976881 1.01
tpcds_q54/datafusion:vortex-file-compressed 38243471 37425626 1.02
tpcds_q55/datafusion:vortex-file-compressed 14003070 13395422 1.05
tpcds_q56/datafusion:vortex-file-compressed 34263911 34164823 1.00
tpcds_q57/datafusion:vortex-file-compressed 98816824 101646215 0.97
tpcds_q58/datafusion:vortex-file-compressed 63296471 61464742 1.03
tpcds_q59/datafusion:vortex-file-compressed 55597614 56069542 0.99
tpcds_q60/datafusion:vortex-file-compressed 32966977 32715191 1.01
tpcds_q61/datafusion:vortex-file-compressed 37453691 37006475 1.01
tpcds_q62/datafusion:vortex-file-compressed 24282728 24696278 0.98
tpcds_q63/datafusion:vortex-file-compressed 24974632 24486151 1.02
tpcds_q64/datafusion:vortex-file-compressed 474117217 511188252 0.93
tpcds_q65/datafusion:vortex-file-compressed 71963961 71509502 1.01
tpcds_q66/datafusion:vortex-file-compressed 78478065 78651371 1.00
tpcds_q67/datafusion:vortex-file-compressed 118930312 121762840 0.98
tpcds_q68/datafusion:vortex-file-compressed 33789487 32551779 1.04
tpcds_q69/datafusion:vortex-file-compressed 🚨 49270403 37821685 1.30
tpcds_q70/datafusion:vortex-file-compressed 111147079 116568185 0.95
tpcds_q71/datafusion:vortex-file-compressed 23370780 23374790 1.00
tpcds_q72/datafusion:vortex-file-compressed 1477453443 1480457120 1.00
tpcds_q73/datafusion:vortex-file-compressed 23951843 24518759 0.98
tpcds_q74/datafusion:vortex-file-compressed 🚨 82585713 75031160 1.10
tpcds_q75/datafusion:vortex-file-compressed 🚨 156375758 139155290 1.12
tpcds_q76/datafusion:vortex-file-compressed 44669720 43764347 1.02
tpcds_q77/datafusion:vortex-file-compressed 43761041 43667203 1.00
tpcds_q78/datafusion:vortex-file-compressed 109629915 106573532 1.03
tpcds_q79/datafusion:vortex-file-compressed 28255456 28815086 0.98
tpcds_q80/datafusion:vortex-file-compressed 101379667 98155676 1.03
tpcds_q81/datafusion:vortex-file-compressed 🚨 32044587 28949080 1.11
tpcds_q82/datafusion:vortex-file-compressed 19579281 18975847 1.03
tpcds_q83/datafusion:vortex-file-compressed 42753642 42095029 1.02
tpcds_q84/datafusion:vortex-file-compressed 🚨 16795613 13939138 1.20
tpcds_q85/datafusion:vortex-file-compressed 🚨 124791836 112297824 1.11
tpcds_q86/datafusion:vortex-file-compressed 19465628 19473642 1.00
tpcds_q87/datafusion:vortex-file-compressed 42977774 42455941 1.01
tpcds_q88/datafusion:vortex-file-compressed 53408291 54026890 0.99
tpcds_q89/datafusion:vortex-file-compressed 28370812 29210354 0.97
tpcds_q90/datafusion:vortex-file-compressed 14233614 14331075 0.99
tpcds_q91/datafusion:vortex-file-compressed 🚨 26952796 19508396 1.38
tpcds_q92/datafusion:vortex-file-compressed 16988809 16750551 1.01
tpcds_q93/datafusion:vortex-file-compressed 31845800 31685934 1.01
tpcds_q94/datafusion:vortex-file-compressed 23691816 23369033 1.01
tpcds_q95/datafusion:vortex-file-compressed 63547461 63444482 1.00
tpcds_q96/datafusion:vortex-file-compressed 11057409 11027482 1.00
tpcds_q97/datafusion:vortex-file-compressed 30389100 29848448 1.02
tpcds_q98/datafusion:vortex-file-compressed 24622396 24859440 0.99
tpcds_q99/datafusion:vortex-file-compressed 28131153 28198873 1.00
datafusion / parquet / ns (1.000x ➖, 2↑ 2↓)
name PR 4547be5 (ns) base be332fc (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 32969114 30733440 1.07
tpcds_q02/datafusion:parquet 52626951 52251971 1.01
tpcds_q03/datafusion:parquet 16962699 17371886 0.98
tpcds_q04/datafusion:parquet 325208153 330302872 0.98
tpcds_q05/datafusion:parquet 80638327 80252807 1.00
tpcds_q06/datafusion:parquet 30279845 30477913 0.99
tpcds_q07/datafusion:parquet 96953526 97611054 0.99
tpcds_q08/datafusion:parquet 37697490 39231788 0.96
tpcds_q09/datafusion:parquet 35447779 37213229 0.95
tpcds_q10/datafusion:parquet 90790824 89006266 1.02
tpcds_q11/datafusion:parquet 167803024 164951517 1.02
tpcds_q12/datafusion:parquet 22800991 22131128 1.03
tpcds_q13/datafusion:parquet 95699619 99708708 0.96
tpcds_q14/datafusion:parquet 281287500 278083458 1.01
tpcds_q15/datafusion:parquet 37282792 38735618 0.96
tpcds_q16/datafusion:parquet 47781612 50312453 0.95
tpcds_q17/datafusion:parquet 108149592 111880524 0.97
tpcds_q18/datafusion:parquet 130790675 132129145 0.99
tpcds_q19/datafusion:parquet 29048357 30007615 0.97
tpcds_q20/datafusion:parquet 🚀 23474137 26779820 0.88
tpcds_q21/datafusion:parquet 22322194 22287278 1.00
tpcds_q22/datafusion:parquet 🚨 128487610 106715262 1.20
tpcds_q23/datafusion:parquet 173738039 171679529 1.01
tpcds_q24/datafusion:parquet 143157987 144105315 0.99
tpcds_q25/datafusion:parquet 106956911 109313232 0.98
tpcds_q26/datafusion:parquet 85346878 84942946 1.00
tpcds_q27/datafusion:parquet 160261504 157792988 1.02
tpcds_q28/datafusion:parquet 40741521 41616954 0.98
tpcds_q29/datafusion:parquet 110108620 105542531 1.04
tpcds_q30/datafusion:parquet 43048638 42841778 1.00
tpcds_q31/datafusion:parquet 94718718 95863815 0.99
tpcds_q32/datafusion:parquet 23858287 23675378 1.01
tpcds_q33/datafusion:parquet 37348765 37669173 0.99
tpcds_q34/datafusion:parquet 30169404 31065520 0.97
tpcds_q35/datafusion:parquet 88722556 89122180 1.00
tpcds_q36/datafusion:parquet 68536002 67822354 1.01
tpcds_q37/datafusion:parquet 24382952 23627369 1.03
tpcds_q38/datafusion:parquet 57755940 56334396 1.03
tpcds_q39/datafusion:parquet 81900407 80367867 1.02
tpcds_q40/datafusion:parquet 33457391 35855395 0.93
tpcds_q41/datafusion:parquet 19129959 19762751 0.97
tpcds_q42/datafusion:parquet 17147209 16609688 1.03
tpcds_q43/datafusion:parquet 22728708 22903016 0.99
tpcds_q44/datafusion:parquet 42790220 42646803 1.00
tpcds_q45/datafusion:parquet 44243359 44649440 0.99
tpcds_q46/datafusion:parquet 42868486 42318033 1.01
tpcds_q47/datafusion:parquet 147953890 149665599 0.99
tpcds_q48/datafusion:parquet 88496181 87876580 1.01
tpcds_q49/datafusion:parquet 75952037 77397893 0.98
tpcds_q50/datafusion:parquet 74585842 70065784 1.06
tpcds_q51/datafusion:parquet 87702975 81702218 1.07
tpcds_q52/datafusion:parquet 16705267 16565432 1.01
tpcds_q53/datafusion:parquet 25037955 25055421 1.00
tpcds_q54/datafusion:parquet 46577140 46792861 1.00
tpcds_q55/datafusion:parquet 16313778 16471056 0.99
tpcds_q56/datafusion:parquet 37227681 37049687 1.00
tpcds_q57/datafusion:parquet 124890788 126273144 0.99
tpcds_q58/datafusion:parquet 82537826 83356484 0.99
tpcds_q59/datafusion:parquet 75951608 77742741 0.98
tpcds_q60/datafusion:parquet 37065527 36857849 1.01
tpcds_q61/datafusion:parquet 45738791 47049276 0.97
tpcds_q62/datafusion:parquet 🚀 27673099 31349044 0.88
tpcds_q63/datafusion:parquet 24883844 25065117 0.99
tpcds_q64/datafusion:parquet 372316589 360111092 1.03
tpcds_q65/datafusion:parquet 48430251 48032558 1.01
tpcds_q66/datafusion:parquet 91960999 83800371 1.10
tpcds_q67/datafusion:parquet 143883206 145503333 0.99
tpcds_q68/datafusion:parquet 40948106 40822059 1.00
tpcds_q69/datafusion:parquet 82391674 84480779 0.98
tpcds_q70/datafusion:parquet 44515536 44073976 1.01
tpcds_q71/datafusion:parquet 26199619 26502048 0.99
tpcds_q72/datafusion:parquet 445768526 448216049 0.99
tpcds_q73/datafusion:parquet 28085104 28516720 0.98
tpcds_q74/datafusion:parquet 98902331 99630801 0.99
tpcds_q75/datafusion:parquet 169670641 179325442 0.95
tpcds_q76/datafusion:parquet 61695587 60281035 1.02
tpcds_q77/datafusion:parquet 55728498 54531908 1.02
tpcds_q78/datafusion:parquet 130629769 124523999 1.05
tpcds_q79/datafusion:parquet 34345085 34424374 1.00
tpcds_q80/datafusion:parquet 98269609 99298933 0.99
tpcds_q81/datafusion:parquet 40977199 39186181 1.05
tpcds_q82/datafusion:parquet 24064478 23468023 1.03
tpcds_q83/datafusion:parquet 57606014 56897428 1.01
tpcds_q84/datafusion:parquet 46818795 47186090 0.99
tpcds_q85/datafusion:parquet 196306169 199843076 0.98
tpcds_q86/datafusion:parquet 20659125 20466064 1.01
tpcds_q87/datafusion:parquet 60245947 63398306 0.95
tpcds_q88/datafusion:parquet 58392426 58323919 1.00
tpcds_q89/datafusion:parquet 30418337 30208208 1.01
tpcds_q90/datafusion:parquet 🚨 20602464 18281284 1.13
tpcds_q91/datafusion:parquet 65958350 66185230 1.00
tpcds_q92/datafusion:parquet 24570245 24469699 1.00
tpcds_q93/datafusion:parquet 36736074 35881338 1.02
tpcds_q94/datafusion:parquet 30471511 30436819 1.00
tpcds_q95/datafusion:parquet 90246476 90144746 1.00
tpcds_q96/datafusion:parquet 16045440 15911664 1.01
tpcds_q97/datafusion:parquet 39173421 39688008 0.99
tpcds_q98/datafusion:parquet 26868158 27842022 0.97
tpcds_q99/datafusion:parquet 35134703 34197794 1.03
duckdb / vortex-file-compressed / ns (1.006x ➖, 4↑ 6↓)
name PR 4547be5 (ns) base be332fc (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 27541560 27095101 1.02
tpcds_q02/duckdb:vortex-file-compressed 29769870 29178698 1.02
tpcds_q03/duckdb:vortex-file-compressed 21624784 20019996 1.08
tpcds_q04/duckdb:vortex-file-compressed 95872466 97974690 0.98
tpcds_q05/duckdb:vortex-file-compressed 39048572 39046944 1.00
tpcds_q06/duckdb:vortex-file-compressed 53263728 53740178 0.99
tpcds_q07/duckdb:vortex-file-compressed 32713287 31773295 1.03
tpcds_q08/duckdb:vortex-file-compressed 33470225 35327107 0.95
tpcds_q09/duckdb:vortex-file-compressed 🚀 18062504 20329155 0.89
tpcds_q10/duckdb:vortex-file-compressed 55160761 54629172 1.01
tpcds_q11/duckdb:vortex-file-compressed 73992152 72852786 1.02
tpcds_q12/duckdb:vortex-file-compressed 17242872 16729756 1.03
tpcds_q13/duckdb:vortex-file-compressed 38816176 39178544 0.99
tpcds_q14/duckdb:vortex-file-compressed 113980644 113247040 1.01
tpcds_q15/duckdb:vortex-file-compressed 35313684 36209730 0.98
tpcds_q16/duckdb:vortex-file-compressed 33973002 35801048 0.95
tpcds_q17/duckdb:vortex-file-compressed 56855181 59302863 0.96
tpcds_q18/duckdb:vortex-file-compressed 50260752 51375207 0.98
tpcds_q19/duckdb:vortex-file-compressed 39479977 41001565 0.96
tpcds_q20/duckdb:vortex-file-compressed 18953133 19927723 0.95
tpcds_q21/duckdb:vortex-file-compressed 20770960 22672638 0.92
tpcds_q22/duckdb:vortex-file-compressed 69403332 67737355 1.02
tpcds_q23/duckdb:vortex-file-compressed 75493624 75538537 1.00
tpcds_q24/duckdb:vortex-file-compressed 51697129 50886152 1.02
tpcds_q25/duckdb:vortex-file-compressed 49063373 49170877 1.00
tpcds_q26/duckdb:vortex-file-compressed 23688875 24238795 0.98
tpcds_q27/duckdb:vortex-file-compressed 34159322 32327644 1.06
tpcds_q28/duckdb:vortex-file-compressed 14518208 14531942 1.00
tpcds_q29/duckdb:vortex-file-compressed 56864752 56828872 1.00
tpcds_q30/duckdb:vortex-file-compressed 36252143 37796047 0.96
tpcds_q31/duckdb:vortex-file-compressed 34428843 33600046 1.02
tpcds_q32/duckdb:vortex-file-compressed 21168458 19775699 1.07
tpcds_q33/duckdb:vortex-file-compressed 34855394 32450625 1.07
tpcds_q34/duckdb:vortex-file-compressed 30964545 31293102 0.99
tpcds_q35/duckdb:vortex-file-compressed 87653796 87485178 1.00
tpcds_q36/duckdb:vortex-file-compressed 🚀 29298863 32610661 0.90
tpcds_q37/duckdb:vortex-file-compressed 25744336 25392740 1.01
tpcds_q38/duckdb:vortex-file-compressed 44128463 43706094 1.01
tpcds_q39/duckdb:vortex-file-compressed 35480850 35559644 1.00
tpcds_q40/duckdb:vortex-file-compressed 23722635 22947220 1.03
tpcds_q41/duckdb:vortex-file-compressed 14183521 14265796 0.99
tpcds_q42/duckdb:vortex-file-compressed 🚨 20578299 17934723 1.15
tpcds_q43/duckdb:vortex-file-compressed 🚨 24107561 21859285 1.10
tpcds_q44/duckdb:vortex-file-compressed 25100290 27152591 0.92
tpcds_q45/duckdb:vortex-file-compressed 38630847 36679615 1.05
tpcds_q46/duckdb:vortex-file-compressed 39623041 39429310 1.00
tpcds_q47/duckdb:vortex-file-compressed 60659345 57817657 1.05
tpcds_q48/duckdb:vortex-file-compressed 37146406 37073800 1.00
tpcds_q49/duckdb:vortex-file-compressed 42535419 42192921 1.01
tpcds_q50/duckdb:vortex-file-compressed 34316884 34274921 1.00
tpcds_q51/duckdb:vortex-file-compressed 🚨 144656097 110879687 1.30
tpcds_q52/duckdb:vortex-file-compressed 🚨 19097526 17064580 1.12
tpcds_q53/duckdb:vortex-file-compressed 28287253 28492585 0.99
tpcds_q54/duckdb:vortex-file-compressed 50497282 48339492 1.04
tpcds_q55/duckdb:vortex-file-compressed 16245029 16765389 0.97
tpcds_q56/duckdb:vortex-file-compressed 33480559 34215075 0.98
tpcds_q57/duckdb:vortex-file-compressed 44445852 43188695 1.03
tpcds_q58/duckdb:vortex-file-compressed 41043500 38944048 1.05
tpcds_q59/duckdb:vortex-file-compressed 39422524 40016277 0.99
tpcds_q60/duckdb:vortex-file-compressed 34589831 34479554 1.00
tpcds_q61/duckdb:vortex-file-compressed 40491436 38286398 1.06
tpcds_q62/duckdb:vortex-file-compressed 18998915 19196697 0.99
tpcds_q63/duckdb:vortex-file-compressed 29711711 28266123 1.05
tpcds_q64/duckdb:vortex-file-compressed 116208232 118846809 0.98
tpcds_q65/duckdb:vortex-file-compressed 26353818 25582910 1.03
tpcds_q66/duckdb:vortex-file-compressed 🚀 39614977 46544686 0.85
tpcds_q67/duckdb:vortex-file-compressed 130125934 138534614 0.94
tpcds_q68/duckdb:vortex-file-compressed 40538246 40267138 1.01
tpcds_q69/duckdb:vortex-file-compressed 55069862 58672898 0.94
tpcds_q70/duckdb:vortex-file-compressed 44409223 42604375 1.04
tpcds_q71/duckdb:vortex-file-compressed 26036180 24861850 1.05
tpcds_q72/duckdb:vortex-file-compressed 150940778 149591492 1.01
tpcds_q73/duckdb:vortex-file-compressed 31515283 30509152 1.03
tpcds_q74/duckdb:vortex-file-compressed 49905248 53460012 0.93
tpcds_q75/duckdb:vortex-file-compressed 63702128 62053190 1.03
tpcds_q76/duckdb:vortex-file-compressed 🚨 26649141 23771207 1.12
tpcds_q77/duckdb:vortex-file-compressed 30643088 31697067 0.97
tpcds_q78/duckdb:vortex-file-compressed 79566436 80435086 0.99
tpcds_q79/duckdb:vortex-file-compressed 32358780 32988203 0.98
tpcds_q80/duckdb:vortex-file-compressed 54253956 55832952 0.97
tpcds_q81/duckdb:vortex-file-compressed 41216966 40664864 1.01
tpcds_q82/duckdb:vortex-file-compressed 54869509 55647639 0.99
tpcds_q83/duckdb:vortex-file-compressed 42703381 39425921 1.08
tpcds_q84/duckdb:vortex-file-compressed 27740035 28165947 0.98
tpcds_q85/duckdb:vortex-file-compressed 56808347 58458956 0.97
tpcds_q86/duckdb:vortex-file-compressed 19590277 19516657 1.00
tpcds_q87/duckdb:vortex-file-compressed 46577517 47434561 0.98
tpcds_q88/duckdb:vortex-file-compressed 68236664 63794040 1.07
tpcds_q89/duckdb:vortex-file-compressed 🚨 29949943 26020506 1.15
tpcds_q90/duckdb:vortex-file-compressed 16520399 17342623 0.95
tpcds_q91/duckdb:vortex-file-compressed 32218173 34657561 0.93
tpcds_q92/duckdb:vortex-file-compressed 24825130 24315832 1.02
tpcds_q93/duckdb:vortex-file-compressed 30102906 29644949 1.02
tpcds_q94/duckdb:vortex-file-compressed 32877716 32769424 1.00
tpcds_q95/duckdb:vortex-file-compressed 149505386 151425376 0.99
tpcds_q96/duckdb:vortex-file-compressed 🚀 18229933 20725020 0.88
tpcds_q97/duckdb:vortex-file-compressed 46601662 42751302 1.09
tpcds_q98/duckdb:vortex-file-compressed 24441927 22997399 1.06
tpcds_q99/duckdb:vortex-file-compressed 26513629 26330117 1.01
duckdb / parquet / ns (0.999x ➖, 3↑ 3↓)
name PR 4547be5 (ns) base be332fc (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 32184331 34283827 0.94
tpcds_q02/duckdb:parquet 🚀 21333965 26828635 0.80
tpcds_q03/duckdb:parquet 12285837 12051549 1.02
tpcds_q04/duckdb:parquet 198582895 195123548 1.02
tpcds_q05/duckdb:parquet 33153816 32933738 1.01
tpcds_q06/duckdb:parquet 34962085 34526917 1.01
tpcds_q07/duckdb:parquet 23196549 22886653 1.01
tpcds_q08/duckdb:parquet 33148567 33413888 0.99
tpcds_q09/duckdb:parquet 30148352 30207475 1.00
tpcds_q10/duckdb:parquet 43489468 40350729 1.08
tpcds_q11/duckdb:parquet 104454809 104579126 1.00
tpcds_q12/duckdb:parquet 17627104 17697326 1.00
tpcds_q13/duckdb:parquet 33757406 34591606 0.98
tpcds_q14/duckdb:parquet 105196704 104537336 1.01
tpcds_q15/duckdb:parquet 35374772 36002459 0.98
tpcds_q16/duckdb:parquet 27648585 27430514 1.01
tpcds_q17/duckdb:parquet 45155578 44987261 1.00
tpcds_q18/duckdb:parquet 57339767 57555637 1.00
tpcds_q19/duckdb:parquet 35862165 36510610 0.98
tpcds_q20/duckdb:parquet 18927782 19355442 0.98
tpcds_q21/duckdb:parquet 🚨 16037677 13839969 1.16
tpcds_q22/duckdb:parquet 🚨 60557080 50080001 1.21
tpcds_q23/duckdb:parquet 67073092 70997575 0.94
tpcds_q24/duckdb:parquet 48613171 48811244 1.00
tpcds_q25/duckdb:parquet 42034662 41590613 1.01
tpcds_q26/duckdb:parquet 46088205 45105591 1.02
tpcds_q27/duckdb:parquet 57290491 52919321 1.08
tpcds_q28/duckdb:parquet 28544589 29935199 0.95
tpcds_q29/duckdb:parquet 42774487 42347510 1.01
tpcds_q30/duckdb:parquet 44510595 43363638 1.03
tpcds_q31/duckdb:parquet 29328481 31207392 0.94
tpcds_q32/duckdb:parquet 14887833 14832997 1.00
tpcds_q33/duckdb:parquet 23675257 23275434 1.02
tpcds_q34/duckdb:parquet 21785054 21808177 1.00
tpcds_q35/duckdb:parquet 68184881 66027860 1.03
tpcds_q36/duckdb:parquet 22341502 22049424 1.01
tpcds_q37/duckdb:parquet 18963213 18896765 1.00
tpcds_q38/duckdb:parquet 41942144 41084688 1.02
tpcds_q39/duckdb:parquet 37041441 36252404 1.02
tpcds_q40/duckdb:parquet 22750363 22780065 1.00
tpcds_q41/duckdb:parquet 10515532 10286330 1.02
tpcds_q42/duckdb:parquet 11647671 11607520 1.00
tpcds_q43/duckdb:parquet 14585976 14566026 1.00
tpcds_q44/duckdb:parquet 24532129 23895244 1.03
tpcds_q45/duckdb:parquet 32757781 33332624 0.98
tpcds_q46/duckdb:parquet 52008925 54172842 0.96
tpcds_q47/duckdb:parquet 49458103 50895576 0.97
tpcds_q48/duckdb:parquet 🚀 30636745 35655360 0.86
tpcds_q49/duckdb:parquet 28538911 28329112 1.01
tpcds_q50/duckdb:parquet 24828121 25581581 0.97
tpcds_q51/duckdb:parquet 98084555 97104160 1.01
tpcds_q52/duckdb:parquet 11793986 11618935 1.02
tpcds_q53/duckdb:parquet 15721545 16415498 0.96
tpcds_q54/duckdb:parquet 29620637 29775186 0.99
tpcds_q55/duckdb:parquet 11699852 11589081 1.01
tpcds_q56/duckdb:parquet 25004799 25359211 0.99
tpcds_q57/duckdb:parquet 42317460 42764229 0.99
tpcds_q58/duckdb:parquet 27068040 27661472 0.98
tpcds_q59/duckdb:parquet 29952134 29802574 1.01
tpcds_q60/duckdb:parquet 26049666 25740586 1.01
tpcds_q61/duckdb:parquet 33819439 33164777 1.02
tpcds_q62/duckdb:parquet 14757536 14996169 0.98
tpcds_q63/duckdb:parquet 15590497 15812069 0.99
tpcds_q64/duckdb:parquet 80966971 81782822 0.99
tpcds_q65/duckdb:parquet 22304954 23546568 0.95
tpcds_q66/duckdb:parquet 34712154 34889210 0.99
tpcds_q67/duckdb:parquet 126730021 133740460 0.95
tpcds_q68/duckdb:parquet 39406954 39464467 1.00
tpcds_q69/duckdb:parquet 41217328 41242242 1.00
tpcds_q70/duckdb:parquet 26924228 26540842 1.01
tpcds_q71/duckdb:parquet 21893136 21799290 1.00
tpcds_q72/duckdb:parquet 🚨 173524678 123293492 1.41
tpcds_q73/duckdb:parquet 18781877 18341246 1.02
tpcds_q74/duckdb:parquet 147078836 144948406 1.01
tpcds_q75/duckdb:parquet 60292878 61088354 0.99
tpcds_q76/duckdb:parquet 18742111 19029483 0.98
tpcds_q77/duckdb:parquet 25015449 25415676 0.98
tpcds_q78/duckdb:parquet 78180853 77982132 1.00
tpcds_q79/duckdb:parquet 🚀 27495920 33067365 0.83
tpcds_q80/duckdb:parquet 46405520 48663058 0.95
tpcds_q81/duckdb:parquet 41532228 41080710 1.01
tpcds_q82/duckdb:parquet 18717157 18955467 0.99
tpcds_q83/duckdb:parquet 22533749 22082056 1.02
tpcds_q84/duckdb:parquet 23246105 23228590 1.00
tpcds_q85/duckdb:parquet 47390252 48004721 0.99
tpcds_q86/duckdb:parquet 15070962 14687485 1.03
tpcds_q87/duckdb:parquet 44693624 43597989 1.03
tpcds_q88/duckdb:parquet 42608043 42627995 1.00
tpcds_q89/duckdb:parquet 20594921 20133251 1.02
tpcds_q90/duckdb:parquet 10526835 10454203 1.01
tpcds_q91/duckdb:parquet 27836791 27482903 1.01
tpcds_q92/duckdb:parquet 15214638 15391189 0.99
tpcds_q93/duckdb:parquet 31377366 34538511 0.91
tpcds_q94/duckdb:parquet 21840239 21923763 1.00
tpcds_q95/duckdb:parquet 137581691 139162315 0.99
tpcds_q96/duckdb:parquet 10272423 10122904 1.01
tpcds_q97/duckdb:parquet 39019689 38740578 1.01
tpcds_q98/duckdb:parquet 21764983 22098338 0.98
tpcds_q99/duckdb:parquet 23672120 23821502 0.99

File Size Changes (25 files changed, -43.5% overall, 0↑ 25↓)
File Scale Format Base HEAD Change %
call_center.vortex 1.0 vortex-compact 47.68 KB 0 B 47.68 KB -100.0%
catalog_page.vortex 1.0 vortex-compact 362.70 KB 0 B 362.70 KB -100.0%
catalog_returns.vortex 1.0 vortex-compact 6.04 MB 0 B 6.04 MB -100.0%
catalog_sales.vortex 1.0 vortex-compact 59.49 MB 0 B 59.49 MB -100.0%
customer.vortex 1.0 vortex-compact 3.29 MB 0 B 3.29 MB -100.0%
customer_address.vortex 1.0 vortex-compact 639.07 KB 0 B 639.07 KB -100.0%
customer_demographics.vortex 1.0 vortex-compact 424.41 KB 0 B 424.41 KB -100.0%
date_dim.vortex 1.0 vortex-compact 140.51 KB 0 B 140.51 KB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
household_demographics.vortex 1.0 vortex-compact 10.52 KB 0 B 10.52 KB -100.0%
income_band.vortex 1.0 vortex-compact 5.80 KB 0 B 5.80 KB -100.0%
inventory.vortex 1.0 vortex-compact 16.07 MB 0 B 16.07 MB -100.0%
item.vortex 1.0 vortex-compact 1000.57 KB 0 B 1000.57 KB -100.0%
promotion.vortex 1.0 vortex-compact 50.55 KB 0 B 50.55 KB -100.0%
reason.vortex 1.0 vortex-compact 6.20 KB 0 B 6.20 KB -100.0%
ship_mode.vortex 1.0 vortex-compact 10.96 KB 0 B 10.96 KB -100.0%
store.vortex 1.0 vortex-compact 43.47 KB 0 B 43.47 KB -100.0%
store_returns.vortex 1.0 vortex-compact 9.36 MB 0 B 9.36 MB -100.0%
store_sales.vortex 1.0 vortex-compact 78.12 MB 0 B 78.12 MB -100.0%
time_dim.vortex 1.0 vortex-compact 96.83 KB 0 B 96.83 KB -100.0%
warehouse.vortex 1.0 vortex-compact 22.38 KB 0 B 22.38 KB -100.0%
web_page.vortex 1.0 vortex-compact 25.24 KB 0 B 25.24 KB -100.0%
web_returns.vortex 1.0 vortex-compact 3.00 MB 0 B 3.00 MB -100.0%
web_sales.vortex 1.0 vortex-compact 29.45 MB 0 B 29.45 MB -100.0%
web_site.vortex 1.0 vortex-compact 42.43 KB 0 B 42.43 KB -100.0%

Totals:

  • vortex-compact: 207.95 MB → 0 B (-100.0%)
  • vortex-file-compressed: 269.98 MB → 269.98 MB (0.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -16.1%
Engines: DataFusion No clear signal (-0.2%, environment too noisy confidence) · DuckDB No clear signal (-29.5%, environment too noisy confidence)
Vortex (geomean): 0.923x ➖
Parquet (geomean): 1.100x ➖
Shifts: Parquet (control) +10.0% · Median polish -4.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (0.821x ➖, 4↑ 2↓)
name PR 4547be5 (ns) base 0f0390a (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 58696930 35453306 1.66
fineweb_q01/datafusion:vortex-file-compressed 🚀 412471673 633584062 0.65
fineweb_q02/datafusion:vortex-file-compressed 🚀 364434070 667826267 0.55
fineweb_q03/datafusion:vortex-file-compressed 🚀 497141618 871925980 0.57
fineweb_q04/datafusion:vortex-file-compressed 537470181 595820104 0.90
fineweb_q05/datafusion:vortex-file-compressed 550068636 544835023 1.01
fineweb_q06/datafusion:vortex-file-compressed 784686007 1000370356 0.78
fineweb_q07/datafusion:vortex-file-compressed 🚨 953225391 723422053 1.32
fineweb_q08/datafusion:vortex-file-compressed 🚀 216235992 401532714 0.54
datafusion / parquet / ns (0.823x ➖, 1↑ 0↓)
name PR 4547be5 (ns) base 0f0390a (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 485659240 746708068 0.65
fineweb_q01/datafusion:parquet 920311143 1035930612 0.89
fineweb_q02/datafusion:parquet 880341094 1046442509 0.84
fineweb_q03/datafusion:parquet 875419252 1047605463 0.84
fineweb_q04/datafusion:parquet 1016270479 1080355258 0.94
fineweb_q05/datafusion:parquet 955514254 1072698467 0.89
fineweb_q06/datafusion:parquet 897929098 1244839163 0.72
fineweb_q07/datafusion:parquet 872581679 1110760608 0.79
fineweb_q08/datafusion:parquet 895025506 998205728 0.90
duckdb / vortex-file-compressed / ns (1.038x ➖, 0↑ 0↓)
name PR 4547be5 (ns) base 0f0390a (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 54005815 53490489 1.01
fineweb_q01/duckdb:vortex-file-compressed 561328455 571709452 0.98
fineweb_q02/duckdb:vortex-file-compressed 507040865 511597650 0.99
fineweb_q03/duckdb:vortex-file-compressed 1726014309 1567613023 1.10
fineweb_q04/duckdb:vortex-file-compressed 1861800497 1901677675 0.98
fineweb_q05/duckdb:vortex-file-compressed 1819219594 1750732011 1.04
fineweb_q06/duckdb:vortex-file-compressed 2108299147 1847078047 1.14
fineweb_q07/duckdb:vortex-file-compressed 1672908717 1537510886 1.09
fineweb_q08/duckdb:vortex-file-compressed 732859427 718042741 1.02
duckdb / parquet / ns (1.471x ❌, 1↑ 3↓)
name PR 4547be5 (ns) base 0f0390a (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚨 5264912404 563023797 9.35
fineweb_q01/duckdb:parquet 🚨 5328735075 563276534 9.46
fineweb_q02/duckdb:parquet 5308257366 5277398200 1.01
fineweb_q03/duckdb:parquet 5354869146 5350841562 1.00
fineweb_q04/duckdb:parquet 5310048019 5239600669 1.01
fineweb_q05/duckdb:parquet 5312373185 5347099274 0.99
fineweb_q06/duckdb:parquet 🚨 5424772636 1479071105 3.67
fineweb_q07/duckdb:parquet 5359358228 5355064515 1.00
fineweb_q08/duckdb:parquet 🚀 514584046 5249994504 0.10

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.2%
Engines: DataFusion No clear signal (+7.9%, environment too noisy confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): 1.042x ➖
Parquet (geomean): 1.000x ➖
Shifts: Parquet (control) -0.0% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.076x ➖, 0↑ 8↓)
name PR 4547be5 (ns) base 74a2b86 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 2045782 2035573 1.01
clickbench_q01/datafusion:vortex-file-compressed 11172318 11179156 1.00
clickbench_q02/datafusion:vortex-file-compressed 24535622 23219072 1.06
clickbench_q03/datafusion:vortex-file-compressed 24887699 25620563 0.97
clickbench_q04/datafusion:vortex-file-compressed 163532678 157402118 1.04
clickbench_q05/datafusion:vortex-file-compressed 221115183 217662878 1.02
clickbench_q06/datafusion:vortex-file-compressed 1942901 1927317 1.01
clickbench_q07/datafusion:vortex-file-compressed 14549303 14289377 1.02
clickbench_q08/datafusion:vortex-file-compressed 219729986 220782611 1.00
clickbench_q09/datafusion:vortex-file-compressed 361588303 360425084 1.00
clickbench_q10/datafusion:vortex-file-compressed 53645266 50183910 1.07
clickbench_q11/datafusion:vortex-file-compressed 62555550 58306617 1.07
clickbench_q12/datafusion:vortex-file-compressed 191420305 192299753 1.00
clickbench_q13/datafusion:vortex-file-compressed 344901950 326879267 1.06
clickbench_q14/datafusion:vortex-file-compressed 205951165 205394468 1.00
clickbench_q15/datafusion:vortex-file-compressed 195610971 195979349 1.00
clickbench_q16/datafusion:vortex-file-compressed 490709052 472707567 1.04
clickbench_q17/datafusion:vortex-file-compressed 478505202 463711033 1.03
clickbench_q18/datafusion:vortex-file-compressed 927942572 911050121 1.02
clickbench_q19/datafusion:vortex-file-compressed 16573980 17894895 0.93
clickbench_q20/datafusion:vortex-file-compressed 207095082 197402343 1.05
clickbench_q21/datafusion:vortex-file-compressed 258711310 268684944 0.96
clickbench_q22/datafusion:vortex-file-compressed 342107461 331790636 1.03
clickbench_q23/datafusion:vortex-file-compressed 🚨 971564772 425509048 2.28
clickbench_q24/datafusion:vortex-file-compressed 🚨 42704433 36831458 1.16
clickbench_q25/datafusion:vortex-file-compressed 🚨 54750587 48649976 1.13
clickbench_q26/datafusion:vortex-file-compressed 40520875 37690288 1.08
clickbench_q27/datafusion:vortex-file-compressed 279034640 279000772 1.00
clickbench_q28/datafusion:vortex-file-compressed 1477722365 1445876135 1.02
clickbench_q29/datafusion:vortex-file-compressed 🚨 47192756 41396981 1.14
clickbench_q30/datafusion:vortex-file-compressed 169434075 168510763 1.01
clickbench_q31/datafusion:vortex-file-compressed 198308496 191143868 1.04
clickbench_q32/datafusion:vortex-file-compressed 845749038 815745820 1.04
clickbench_q33/datafusion:vortex-file-compressed 989528041 1005006883 0.98
clickbench_q34/datafusion:vortex-file-compressed 985004197 984053643 1.00
clickbench_q35/datafusion:vortex-file-compressed 165466219 170388744 0.97
clickbench_q36/datafusion:vortex-file-compressed 61657315 59408345 1.04
clickbench_q37/datafusion:vortex-file-compressed 30654279 28852649 1.06
clickbench_q38/datafusion:vortex-file-compressed 🚨 32103601 15638551 2.05
clickbench_q39/datafusion:vortex-file-compressed 🚨 170992882 134600624 1.27
clickbench_q40/datafusion:vortex-file-compressed 14351283 13213360 1.09
clickbench_q41/datafusion:vortex-file-compressed 🚨 14872638 12309145 1.21
clickbench_q42/datafusion:vortex-file-compressed 🚨 15631007 13609684 1.15
datafusion / parquet / ns (0.997x ➖, 2↑ 1↓)
name PR 4547be5 (ns) base 74a2b86 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚨 2240491 1940690 1.15
clickbench_q01/datafusion:parquet 17541071 17463684 1.00
clickbench_q02/datafusion:parquet 32608227 30473956 1.07
clickbench_q03/datafusion:parquet 25617951 26133493 0.98
clickbench_q04/datafusion:parquet 174144337 171633336 1.01
clickbench_q05/datafusion:parquet 236690250 231989555 1.02
clickbench_q06/datafusion:parquet 1968649 1950132 1.01
clickbench_q07/datafusion:parquet 18316615 18349353 1.00
clickbench_q08/datafusion:parquet 232212563 230289310 1.01
clickbench_q09/datafusion:parquet 375903995 374591298 1.00
clickbench_q10/datafusion:parquet 72052745 72048392 1.00
clickbench_q11/datafusion:parquet 92533921 92558552 1.00
clickbench_q12/datafusion:parquet 239536781 237736228 1.01
clickbench_q13/datafusion:parquet 398486997 393225492 1.01
clickbench_q14/datafusion:parquet 255789164 254229329 1.01
clickbench_q15/datafusion:parquet 195339468 193208196 1.01
clickbench_q16/datafusion:parquet 481365439 490433580 0.98
clickbench_q17/datafusion:parquet 489564505 479296779 1.02
clickbench_q18/datafusion:parquet 956630315 919440241 1.04
clickbench_q19/datafusion:parquet 23696810 24008691 0.99
clickbench_q20/datafusion:parquet 458742831 453377010 1.01
clickbench_q21/datafusion:parquet 494874742 496203074 1.00
clickbench_q22/datafusion:parquet 660559185 656701710 1.01
clickbench_q23/datafusion:parquet 2873916201 2888381276 0.99
clickbench_q24/datafusion:parquet 48655634 49713511 0.98
clickbench_q25/datafusion:parquet 97182025 99394087 0.98
clickbench_q26/datafusion:parquet 49194043 49010078 1.00
clickbench_q27/datafusion:parquet 539565807 527673277 1.02
clickbench_q28/datafusion:parquet 1533226756 1528736854 1.00
clickbench_q29/datafusion:parquet 🚀 41873310 55713916 0.75
clickbench_q30/datafusion:parquet 241982077 240092142 1.01
clickbench_q31/datafusion:parquet 278881601 274782011 1.01
clickbench_q32/datafusion:parquet 852696447 840566721 1.01
clickbench_q33/datafusion:parquet 1102572402 1082688234 1.02
clickbench_q34/datafusion:parquet 1072785945 1069908780 1.00
clickbench_q35/datafusion:parquet 🚀 163098276 191811062 0.85
clickbench_q36/datafusion:parquet 118120121 121327374 0.97
clickbench_q37/datafusion:parquet 50065998 47822221 1.05
clickbench_q38/datafusion:parquet 68195376 69368866 0.98
clickbench_q39/datafusion:parquet 223727177 230940702 0.97
clickbench_q40/datafusion:parquet 25685680 26180295 0.98
clickbench_q41/datafusion:parquet 24365057 24061093 1.01
clickbench_q42/datafusion:parquet 26364167 26308655 1.00
duckdb / vortex-file-compressed / ns (1.009x ➖, 1↑ 2↓)
name PR 4547be5 (ns) base 74a2b86 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 13671307 12490930 1.09
clickbench_q01/duckdb:vortex-file-compressed 21327358 22287573 0.96
clickbench_q02/duckdb:vortex-file-compressed 23044827 23440602 0.98
clickbench_q03/duckdb:vortex-file-compressed 35391847 35935227 0.98
clickbench_q04/duckdb:vortex-file-compressed 129428198 136503837 0.95
clickbench_q05/duckdb:vortex-file-compressed 163234801 155280700 1.05
clickbench_q06/duckdb:vortex-file-compressed 20860754 22120204 0.94
clickbench_q07/duckdb:vortex-file-compressed 26107839 24858389 1.05
clickbench_q08/duckdb:vortex-file-compressed 165286350 168373038 0.98
clickbench_q09/duckdb:vortex-file-compressed 202387432 201868614 1.00
clickbench_q10/duckdb:vortex-file-compressed 67093949 71843380 0.93
clickbench_q11/duckdb:vortex-file-compressed 72160870 70040525 1.03
clickbench_q12/duckdb:vortex-file-compressed 203907721 189409400 1.08
clickbench_q13/duckdb:vortex-file-compressed 353720067 346224893 1.02
clickbench_q14/duckdb:vortex-file-compressed 225281892 214319643 1.05
clickbench_q15/duckdb:vortex-file-compressed 184231361 184075488 1.00
clickbench_q16/duckdb:vortex-file-compressed 394784198 406962066 0.97
clickbench_q17/duckdb:vortex-file-compressed 375829519 376436081 1.00
clickbench_q18/duckdb:vortex-file-compressed 718888364 730962152 0.98
clickbench_q19/duckdb:vortex-file-compressed 27242535 29582446 0.92
clickbench_q20/duckdb:vortex-file-compressed 249745387 235651397 1.06
clickbench_q21/duckdb:vortex-file-compressed 326682962 333702013 0.98
clickbench_q22/duckdb:vortex-file-compressed 519322513 490920901 1.06
clickbench_q23/duckdb:vortex-file-compressed 198864001 212016758 0.94
clickbench_q24/duckdb:vortex-file-compressed 58955833 59914133 0.98
clickbench_q25/duckdb:vortex-file-compressed 🚨 80412155 72935043 1.10
clickbench_q26/duckdb:vortex-file-compressed 76666485 74323177 1.03
clickbench_q27/duckdb:vortex-file-compressed 181054038 175843494 1.03
clickbench_q28/duckdb:vortex-file-compressed 🚨 1603384833 1268350720 1.26
clickbench_q29/duckdb:vortex-file-compressed 🚀 28426623 31667189 0.90
clickbench_q30/duckdb:vortex-file-compressed 159512612 158892357 1.00
clickbench_q31/duckdb:vortex-file-compressed 322835881 295916964 1.09
clickbench_q32/duckdb:vortex-file-compressed 910048874 922093146 0.99
clickbench_q33/duckdb:vortex-file-compressed 1075620827 1092472666 0.98
clickbench_q34/duckdb:vortex-file-compressed 1116301536 1135064840 0.98
clickbench_q35/duckdb:vortex-file-compressed 208701582 210914969 0.99
clickbench_q36/duckdb:vortex-file-compressed 34718596 34004239 1.02
clickbench_q37/duckdb:vortex-file-compressed 26198154 25558797 1.03
clickbench_q38/duckdb:vortex-file-compressed 31293165 30399389 1.03
clickbench_q39/duckdb:vortex-file-compressed 49061981 48706304 1.01
clickbench_q40/duckdb:vortex-file-compressed 26060353 28094710 0.93
clickbench_q41/duckdb:vortex-file-compressed 27042730 26243097 1.03
clickbench_q42/duckdb:vortex-file-compressed 27827133 26660592 1.04
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name PR 4547be5 (ns) base 74a2b86 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 16433142 17684351 0.93
clickbench_q01/duckdb:parquet 16309280 16757068 0.97
clickbench_q02/duckdb:parquet 25283724 23546554 1.07
clickbench_q03/duckdb:parquet 26454680 24844187 1.06
clickbench_q04/duckdb:parquet 129870453 130151979 1.00
clickbench_q05/duckdb:parquet 196836687 192399358 1.02
clickbench_q06/duckdb:parquet 23939072 22215649 1.08
clickbench_q07/duckdb:parquet 20022299 19378101 1.03
clickbench_q08/duckdb:parquet 163437055 162273788 1.01
clickbench_q09/duckdb:parquet 229690693 228603254 1.00
clickbench_q10/duckdb:parquet 59236666 58536798 1.01
clickbench_q11/duckdb:parquet 66042052 67035492 0.99
clickbench_q12/duckdb:parquet 173876993 174201277 1.00
clickbench_q13/duckdb:parquet 306617292 308390083 0.99
clickbench_q14/duckdb:parquet 187554423 187745423 1.00
clickbench_q15/duckdb:parquet 181889041 184464931 0.99
clickbench_q16/duckdb:parquet 357963923 356883304 1.00
clickbench_q17/duckdb:parquet 359047400 369364827 0.97
clickbench_q18/duckdb:parquet 691569498 685465736 1.01
clickbench_q19/duckdb:parquet 21516962 20580305 1.05
clickbench_q20/duckdb:parquet 257287421 254644855 1.01
clickbench_q21/duckdb:parquet 314176970 313599118 1.00
clickbench_q22/duckdb:parquet 466325617 490976385 0.95
clickbench_q23/duckdb:parquet 253647604 242008225 1.05
clickbench_q24/duckdb:parquet 68232731 67548609 1.01
clickbench_q25/duckdb:parquet 72235023 73433546 0.98
clickbench_q26/duckdb:parquet 47644770 50318740 0.95
clickbench_q27/duckdb:parquet 267860502 273453324 0.98
clickbench_q28/duckdb:parquet 1700750292 1770933308 0.96
clickbench_q29/duckdb:parquet 27214339 26716646 1.02
clickbench_q30/duckdb:parquet 173211766 176014666 0.98
clickbench_q31/duckdb:parquet 310999117 309671830 1.00
clickbench_q32/duckdb:parquet 907491755 905003025 1.00
clickbench_q33/duckdb:parquet 769268775 777253307 0.99
clickbench_q34/duckdb:parquet 792695704 791546702 1.00
clickbench_q35/duckdb:parquet 209084923 209298500 1.00
clickbench_q36/duckdb:parquet 47387091 47974421 0.99
clickbench_q37/duckdb:parquet 36239958 37294867 0.97
clickbench_q38/duckdb:parquet 39515981 38311210 1.03
clickbench_q39/duckdb:parquet 89437490 87630863 1.02
clickbench_q40/duckdb:parquet 19647051 20673193 0.95
clickbench_q41/duckdb:parquet 19899078 19394052 1.03
clickbench_q42/duckdb:parquet 24262029 22962544 1.06

File Size Changes (101 files changed, -39.2% overall, 0↑ 101↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_0.vortex 1.0 vortex-compact 58.88 MB 0 B 58.88 MB -100.0%
hits_1.vortex 1.0 vortex-compact 90.67 MB 0 B 90.67 MB -100.0%
hits_10.vortex 1.0 vortex-compact 49.48 MB 0 B 49.48 MB -100.0%
hits_11.vortex 1.0 vortex-compact 56.11 MB 0 B 56.11 MB -100.0%
hits_12.vortex 1.0 vortex-compact 69.86 MB 0 B 69.86 MB -100.0%
hits_13.vortex 1.0 vortex-compact 69.24 MB 0 B 69.24 MB -100.0%
hits_14.vortex 1.0 vortex-compact 74.88 MB 0 B 74.88 MB -100.0%
hits_15.vortex 1.0 vortex-compact 48.41 MB 0 B 48.41 MB -100.0%
hits_16.vortex 1.0 vortex-compact 49.56 MB 0 B 49.56 MB -100.0%
hits_17.vortex 1.0 vortex-compact 58.79 MB 0 B 58.79 MB -100.0%
hits_18.vortex 1.0 vortex-compact 64.89 MB 0 B 64.89 MB -100.0%
hits_19.vortex 1.0 vortex-compact 49.73 MB 0 B 49.73 MB -100.0%
hits_2.vortex 1.0 vortex-compact 129.16 MB 0 B 129.16 MB -100.0%
hits_20.vortex 1.0 vortex-compact 38.36 MB 0 B 38.36 MB -100.0%
hits_21.vortex 1.0 vortex-compact 51.99 MB 0 B 51.99 MB -100.0%
hits_22.vortex 1.0 vortex-compact 46.22 MB 0 B 46.22 MB -100.0%
hits_23.vortex 1.0 vortex-compact 46.13 MB 0 B 46.13 MB -100.0%
hits_24.vortex 1.0 vortex-compact 45.11 MB 0 B 45.11 MB -100.0%
hits_25.vortex 1.0 vortex-compact 73.88 MB 0 B 73.88 MB -100.0%
hits_26.vortex 1.0 vortex-compact 71.99 MB 0 B 71.99 MB -100.0%
hits_27.vortex 1.0 vortex-compact 69.86 MB 0 B 69.86 MB -100.0%
hits_28.vortex 1.0 vortex-compact 70.92 MB 0 B 70.92 MB -100.0%
hits_29.vortex 1.0 vortex-compact 36.68 MB 0 B 36.68 MB -100.0%
hits_3.vortex 1.0 vortex-compact 95.12 MB 0 B 95.12 MB -100.0%
hits_30.vortex 1.0 vortex-compact 58.58 MB 0 B 58.58 MB -100.0%
hits_31.vortex 1.0 vortex-compact 55.77 MB 0 B 55.77 MB -100.0%
hits_32.vortex 1.0 vortex-compact 44.61 MB 0 B 44.61 MB -100.0%
hits_33.vortex 1.0 vortex-compact 35.92 MB 0 B 35.92 MB -100.0%
hits_34.vortex 1.0 vortex-compact 58.24 MB 0 B 58.24 MB -100.0%
hits_35.vortex 1.0 vortex-compact 75.53 MB 0 B 75.53 MB -100.0%
hits_36.vortex 1.0 vortex-compact 49.21 MB 0 B 49.21 MB -100.0%
hits_37.vortex 1.0 vortex-compact 54.76 MB 0 B 54.76 MB -100.0%
hits_38.vortex 1.0 vortex-compact 63.39 MB 0 B 63.39 MB -100.0%
hits_39.vortex 1.0 vortex-compact 50.10 MB 0 B 50.10 MB -100.0%
hits_4.vortex 1.0 vortex-compact 71.94 MB 0 B 71.94 MB -100.0%
hits_40.vortex 1.0 vortex-compact 77.42 MB 0 B 77.42 MB -100.0%
hits_41.vortex 1.0 vortex-compact 166.05 MB 0 B 166.05 MB -100.0%
hits_42.vortex 1.0 vortex-compact 164.53 MB 0 B 164.53 MB -100.0%
hits_43.vortex 1.0 vortex-compact 169.21 MB 0 B 169.21 MB -100.0%
hits_44.vortex 1.0 vortex-compact 133.26 MB 0 B 133.26 MB -100.0%
hits_45.vortex 1.0 vortex-compact 75.80 MB 0 B 75.80 MB -100.0%
hits_46.vortex 1.0 vortex-compact 42.27 MB 0 B 42.27 MB -100.0%
hits_47.vortex 1.0 vortex-compact 18.22 MB 0 B 18.22 MB -100.0%
hits_48.vortex 1.0 vortex-compact 17.85 MB 0 B 17.85 MB -100.0%
hits_49.vortex 1.0 vortex-compact 51.00 MB 0 B 51.00 MB -100.0%
hits_5.vortex 1.0 vortex-compact 63.33 MB 0 B 63.33 MB -100.0%
hits_50.vortex 1.0 vortex-compact 114.20 MB 0 B 114.20 MB -100.0%
hits_51.vortex 1.0 vortex-compact 168.34 MB 0 B 168.34 MB -100.0%
hits_52.vortex 1.0 vortex-compact 65.08 MB 0 B 65.08 MB -100.0%
hits_53.vortex 1.0 vortex-compact 60.05 MB 0 B 60.05 MB -100.0%
hits_54.vortex 1.0 vortex-compact 117.57 MB 0 B 117.57 MB -100.0%
hits_55.vortex 1.0 vortex-compact 92.56 MB 0 B 92.56 MB -100.0%
hits_56.vortex 1.0 vortex-compact 78.58 MB 0 B 78.58 MB -100.0%
hits_57.vortex 1.0 vortex-compact 83.73 MB 0 B 83.73 MB -100.0%
hits_58.vortex 1.0 vortex-compact 61.24 MB 0 B 61.24 MB -100.0%
hits_59.vortex 1.0 vortex-compact 66.68 MB 0 B 66.68 MB -100.0%
hits_6.vortex 1.0 vortex-compact 63.57 MB 0 B 63.57 MB -100.0%
hits_60.vortex 1.0 vortex-compact 64.92 MB 0 B 64.92 MB -100.0%
hits_61.vortex 1.0 vortex-compact 57.73 MB 0 B 57.73 MB -100.0%
hits_62.vortex 1.0 vortex-compact 75.45 MB 0 B 75.45 MB -100.0%
hits_63.vortex 1.0 vortex-compact 46.44 MB 0 B 46.44 MB -100.0%
hits_64.vortex 1.0 vortex-compact 54.09 MB 0 B 54.09 MB -100.0%
hits_65.vortex 1.0 vortex-compact 129.40 MB 0 B 129.40 MB -100.0%
hits_66.vortex 1.0 vortex-compact 53.52 MB 0 B 53.52 MB -100.0%
hits_67.vortex 1.0 vortex-compact 114.44 MB 0 B 114.44 MB -100.0%
hits_68.vortex 1.0 vortex-compact 76.67 MB 0 B 76.67 MB -100.0%
hits_69.vortex 1.0 vortex-compact 80.98 MB 0 B 80.98 MB -100.0%
hits_7.vortex 1.0 vortex-compact 64.19 MB 0 B 64.19 MB -100.0%
hits_70.vortex 1.0 vortex-compact 61.84 MB 0 B 61.84 MB -100.0%
hits_71.vortex 1.0 vortex-compact 69.96 MB 0 B 69.96 MB -100.0%
hits_72.vortex 1.0 vortex-compact 52.74 MB 0 B 52.74 MB -100.0%
hits_73.vortex 1.0 vortex-compact 71.07 MB 0 B 71.07 MB -100.0%
hits_74.vortex 1.0 vortex-compact 71.87 MB 0 B 71.87 MB -100.0%
hits_75.vortex 1.0 vortex-compact 45.12 MB 0 B 45.12 MB -100.0%
hits_76.vortex 1.0 vortex-compact 77.10 MB 0 B 77.10 MB -100.0%
hits_77.vortex 1.0 vortex-compact 118.50 MB 0 B 118.50 MB -100.0%
hits_78.vortex 1.0 vortex-compact 97.85 MB 0 B 97.85 MB -100.0%
hits_79.vortex 1.0 vortex-compact 86.17 MB 0 B 86.17 MB -100.0%
hits_8.vortex 1.0 vortex-compact 63.39 MB 0 B 63.39 MB -100.0%
hits_80.vortex 1.0 vortex-compact 68.67 MB 0 B 68.67 MB -100.0%
hits_81.vortex 1.0 vortex-compact 65.95 MB 0 B 65.95 MB -100.0%
hits_82.vortex 1.0 vortex-compact 67.43 MB 0 B 67.43 MB -100.0%
hits_83.vortex 1.0 vortex-compact 53.62 MB 0 B 53.62 MB -100.0%
hits_84.vortex 1.0 vortex-compact 74.35 MB 0 B 74.35 MB -100.0%
hits_85.vortex 1.0 vortex-compact 52.86 MB 0 B 52.86 MB -100.0%
hits_86.vortex 1.0 vortex-compact 49.12 MB 0 B 49.12 MB -100.0%
hits_87.vortex 1.0 vortex-compact 118.86 MB 0 B 118.86 MB -100.0%
hits_88.vortex 1.0 vortex-compact 73.59 MB 0 B 73.59 MB -100.0%
hits_89.vortex 1.0 vortex-compact 114.10 MB 0 B 114.10 MB -100.0%
hits_9.vortex 1.0 vortex-compact 66.32 MB 0 B 66.32 MB -100.0%
hits_90.vortex 1.0 vortex-compact 82.09 MB 0 B 82.09 MB -100.0%
hits_91.vortex 1.0 vortex-compact 61.24 MB 0 B 61.24 MB -100.0%
hits_92.vortex 1.0 vortex-compact 94.40 MB 0 B 94.40 MB -100.0%
hits_93.vortex 1.0 vortex-compact 59.92 MB 0 B 59.92 MB -100.0%
hits_94.vortex 1.0 vortex-compact 90.90 MB 0 B 90.90 MB -100.0%
hits_95.vortex 1.0 vortex-compact 58.20 MB 0 B 58.20 MB -100.0%
hits_96.vortex 1.0 vortex-compact 91.74 MB 0 B 91.74 MB -100.0%
hits_97.vortex 1.0 vortex-compact 69.58 MB 0 B 69.58 MB -100.0%
hits_98.vortex 1.0 vortex-compact 73.15 MB 0 B 73.15 MB -100.0%
hits_99.vortex 1.0 vortex-compact 77.65 MB 0 B 77.65 MB -100.0%

Totals:

  • vortex-compact: 7.11 GB → 0 B (-100.0%)
  • vortex-file-compressed: 11.04 GB → 11.04 GB (0.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +10.5%
Engines: DataFusion No clear signal (+15.2%, environment too noisy confidence) · DuckDB No clear signal (+6.0%, environment too noisy confidence)
Vortex (geomean): 1.120x ➖
Parquet (geomean): 1.014x ➖
Shifts: Parquet (control) +1.4% · Median polish +6.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.155x ➖, 1↑ 6↓)
name PR 4547be5 (ns) base 0f0390a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 313689708 249270103 1.26
tpch_q02/datafusion:vortex-file-compressed 🚨 659675246 473768194 1.39
tpch_q03/datafusion:vortex-file-compressed 🚨 486839352 335294726 1.45
tpch_q04/datafusion:vortex-file-compressed 186358777 167783812 1.11
tpch_q05/datafusion:vortex-file-compressed 498626169 447463561 1.11
tpch_q06/datafusion:vortex-file-compressed 257902229 335120286 0.77
tpch_q07/datafusion:vortex-file-compressed 🚀 378534811 652019891 0.58
tpch_q08/datafusion:vortex-file-compressed 632836691 698614559 0.91
tpch_q09/datafusion:vortex-file-compressed 413554116 386497738 1.07
tpch_q10/datafusion:vortex-file-compressed 406601886 409525988 0.99
tpch_q11/datafusion:vortex-file-compressed 314680593 395579647 0.80
tpch_q12/datafusion:vortex-file-compressed 458496071 360039586 1.27
tpch_q13/datafusion:vortex-file-compressed 133338818 127305197 1.05
tpch_q14/datafusion:vortex-file-compressed 239516783 191938647 1.25
tpch_q15/datafusion:vortex-file-compressed 404324473 350494553 1.15
tpch_q16/datafusion:vortex-file-compressed 347771432 299522514 1.16
tpch_q17/datafusion:vortex-file-compressed 🚨 526854924 388975809 1.35
tpch_q18/datafusion:vortex-file-compressed 🚨 505863057 323654678 1.56
tpch_q19/datafusion:vortex-file-compressed 645016727 565631416 1.14
tpch_q20/datafusion:vortex-file-compressed 424744619 459960062 0.92
tpch_q21/datafusion:vortex-file-compressed 🚨 1054233612 542618358 1.94
tpch_q22/datafusion:vortex-file-compressed 🚨 385175343 168103837 2.29
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name PR 4547be5 (ns) base 0f0390a (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 210308923 247272299 0.85
tpch_q02/datafusion:parquet 281414937 287751968 0.98
tpch_q03/datafusion:parquet 311054055 316678386 0.98
tpch_q04/datafusion:parquet 192616576 190374191 1.01
tpch_q05/datafusion:parquet 378524884 395381726 0.96
tpch_q06/datafusion:parquet 172004702 152608738 1.13
tpch_q07/datafusion:parquet 370511196 372138786 1.00
tpch_q08/datafusion:parquet 446199449 457606718 0.98
tpch_q09/datafusion:parquet 462154135 470324018 0.98
tpch_q10/datafusion:parquet 411140614 417751213 0.98
tpch_q11/datafusion:parquet 273456871 283176701 0.97
tpch_q12/datafusion:parquet 214728437 200323866 1.07
tpch_q13/datafusion:parquet 455163398 459514311 0.99
tpch_q14/datafusion:parquet 193991938 176619394 1.10
tpch_q15/datafusion:parquet 277657886 332707836 0.83
tpch_q16/datafusion:parquet 139116925 127458611 1.09
tpch_q17/datafusion:parquet 325583731 327106014 1.00
tpch_q18/datafusion:parquet 446243666 442804141 1.01
tpch_q19/datafusion:parquet 200942465 185722571 1.08
tpch_q20/datafusion:parquet 311595097 272098742 1.15
tpch_q21/datafusion:parquet 473406166 447051093 1.06
tpch_q22/datafusion:parquet 186806164 199613715 0.94
duckdb / vortex-file-compressed / ns (1.087x ➖, 0↑ 3↓)
name PR 4547be5 (ns) base 0f0390a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 261392938 258455844 1.01
tpch_q02/duckdb:vortex-file-compressed 622451045 611586693 1.02
tpch_q03/duckdb:vortex-file-compressed 465156603 585668976 0.79
tpch_q04/duckdb:vortex-file-compressed 369519064 336394405 1.10
tpch_q05/duckdb:vortex-file-compressed 628349934 615328887 1.02
tpch_q06/duckdb:vortex-file-compressed 🚨 423975375 290235455 1.46
tpch_q07/duckdb:vortex-file-compressed 644097545 576238125 1.12
tpch_q08/duckdb:vortex-file-compressed 829401527 766612570 1.08
tpch_q09/duckdb:vortex-file-compressed 597080090 572579937 1.04
tpch_q10/duckdb:vortex-file-compressed 495040673 479052849 1.03
tpch_q11/duckdb:vortex-file-compressed 279242138 262309384 1.06
tpch_q12/duckdb:vortex-file-compressed 🚨 762250399 560572643 1.36
tpch_q13/duckdb:vortex-file-compressed 340412147 336171893 1.01
tpch_q14/duckdb:vortex-file-compressed 333107956 317404959 1.05
tpch_q15/duckdb:vortex-file-compressed 208250893 187052119 1.11
tpch_q16/duckdb:vortex-file-compressed 281846996 267638312 1.05
tpch_q17/duckdb:vortex-file-compressed 🚨 627242216 462886337 1.36
tpch_q18/duckdb:vortex-file-compressed 387486118 352655459 1.10
tpch_q19/duckdb:vortex-file-compressed 390404171 350597217 1.11
tpch_q20/duckdb:vortex-file-compressed 530854408 546091630 0.97
tpch_q21/duckdb:vortex-file-compressed 799696376 766281493 1.04
tpch_q22/duckdb:vortex-file-compressed 176807161 149918501 1.18
duckdb / parquet / ns (1.025x ➖, 0↑ 0↓)
name PR 4547be5 (ns) base 0f0390a (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 352195969 353498073 1.00
tpch_q02/duckdb:parquet 720076446 760766555 0.95
tpch_q03/duckdb:parquet 919245566 815595419 1.13
tpch_q04/duckdb:parquet 537940933 517550731 1.04
tpch_q05/duckdb:parquet 1022605634 993879093 1.03
tpch_q06/duckdb:parquet 357752872 330851875 1.08
tpch_q07/duckdb:parquet 950802376 914518262 1.04
tpch_q08/duckdb:parquet 1200284426 1126371139 1.07
tpch_q09/duckdb:parquet 1152613000 1125596879 1.02
tpch_q10/duckdb:parquet 1124362943 1035823283 1.09
tpch_q11/duckdb:parquet 482833494 434187675 1.11
tpch_q12/duckdb:parquet 555178043 636383165 0.87
tpch_q13/duckdb:parquet 872263259 903233518 0.97
tpch_q14/duckdb:parquet 591364438 568575822 1.04
tpch_q15/duckdb:parquet 403658186 465525644 0.87
tpch_q16/duckdb:parquet 556059605 525991271 1.06
tpch_q17/duckdb:parquet 556731210 531874901 1.05
tpch_q18/duckdb:parquet 723162937 700955057 1.03
tpch_q19/duckdb:parquet 633093436 607602160 1.04
tpch_q20/duckdb:parquet 926008092 913436511 1.01
tpch_q21/duckdb:parquet 802199108 792411171 1.01
tpch_q22/duckdb:parquet 493264795 447819089 1.10

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant