Skip to content

Skip per-split zone-mask expansion when covering zones are uniform - #9274

Draft
joseph-isaacs wants to merge 2 commits into
developfrom
claude/layoutreader-v1-scan-perf-0l1nci
Draft

Skip per-split zone-mask expansion when covering zones are uniform#9274
joseph-isaacs wants to merge 2 commits into
developfrom
claude/layoutreader-v1-scan-perf-0l1nci

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Rationale for this change

ZonedReader::pruning_evaluation (the v1 LayoutReader scan path) caches the zone-level
pruning mask per expression, but every split still expands it into a row-aligned buffer
inside the returned MaskFuture:

  1. a Vec of per-zone lengths, built eagerly — before the future is even polled,
  2. a BitBufferMut of the full split length filled via append_n per zone,
  3. Mask::from(builder.freeze()) — a popcount pass,
  4. a bitand against the incoming mask.

For most splits the zones covering that split are uniform — either none are pruned or
all are — and the whole expansion collapses to a constant. This PR detects that case and
skips the work.

What changes are included in this PR?

vortex-layout/src/layouts/zoned/reader.rs, plus a new benchmark for the path it changes.

After resolving the zone-level pruning mask, count the pruned bits among only the zones
covering this split
(zone_range) before building anything. That count is a handful of
bit reads via BitBuffer::count_range — it does not scan the whole zone mask — and it
short-circuits both uniform cases:

  • no covered zone pruned → the stats mask is all-true, so intersecting is a no-op:
    continue with the incoming mask unchanged (still forwarded to the data child evaluation,
    as before);
  • every covered zone pruned → return Mask::new_false(mask.len()) directly;
  • otherwise → fall through to the existing expansion.

The per-zone length computation moved onto the non-uniform path and inlined into the
builder loop, dropping the intermediate Vec, so uniform splits allocate nothing.
first_row_offset became a private free function so the non-uniform path can call it from
the 'static future without capturing the reader.

The default zone length and row block size are both 8192, so a typical split covers one
zone and the uniform test essentially always succeeds.

Why the fast paths are exactly equivalent

Not merely bit-equal — the same Mask variant. Mask::from_buffer
(vortex-mask/src/lib.rs:189) canonicalises:

if true_count == 0   { return Self::AllFalse(len); }
if true_count == len { return Self::AllTrue(len); }

and owned-left bitand (vortex-mask/src/bitops.rs:41) short-circuits on both:

(AllOr::None, _) | (_, AllOr::None) => Mask::new_false(self.len()),
(_, AllOr::All) => self,

So in the no-prune case the old code built an all-ones buffer, ran an O(n)
true_count(), got AllTrue, and then bitand returned self — the incoming mask,
unchanged. The buffer was allocated, filled, counted and dropped to rediscover a value the
code already held. The all-pruned case is the same story via AllFalseMask::new_false.

Benchmarks

The change is measured directly, by a new vortex-layout/benches/zone_mask_expansion.rs.
expand reproduces the old behaviour and uniform is the fast path; the incoming mask is a
Values mask, not AllTrue, so bitand takes the (AllOr::Some, AllOr::All) => self
branch the real code hits rather than the all-true short circuit. Medians, split of 8192
rows over one zone:

case fast path old expansion
no covered zone pruned 7.4 ns 147 ns ~20x
every covered zone pruned 14.5 ns 151 ns ~10x
no covered zone pruned, 65536 rows / 8 zones 7.4 ns 420 ns ~57x

So the saving is roughly 140–400 ns per split, per pruning expression — real work
removed, but small next to what a split then does: decode 8192 rows across every projected
column.

mixed_zones covers the case where the covering zones genuinely disagree and the expansion
still runs. There the added count_range shows a small overhead — within a few percent, at
the edge of what the host resolves — so it is bounded rather than claimed to be free.

The SQL suites cannot resolve this, across three sweeps

Only the SQL suites exercise pruning_evaluation at all: random-access-bench reads rows
without filter pushdown, string-bench is a compression benchmark, and CodSpeed's
microbenchmarks do not cover vortex-layout. All three report clean, but none of them can
speak to this change.

Three full sweeps were run:
bench-sql on 0fa9c84,
bench-all on ec8e480,
and bench-all on 3062ebb.
Every suite in all three returned "No clear signal". Attributed Vortex impact:

suite sweep 1 sweep 2 sweep 3 range
StatPopGen −6.0% +1.8% −0.1% 7.8 pts
ClickBench Sorted −2.8% +1.4% +4.4% 7.2 pts
FineWeb +3.3% +2.7% +0.0% 3.3 pts
PolarSignals (raw, no control) +1.7% −2.0% −2.2% 3.9 pts
TPC-DS SF=1 −1.4% +0.7% +1.0% 2.4 pts
TPC-H SF=10 −0.3% +1.2% −1.1% 2.3 pts
TPC-H SF=1 +1.2% +1.1% +0.7% 0.5 pts
ClickBench −0.3% −1.0% −0.6% 0.7 pts
Appian NVMe +0.2% −0.3% 0.5 pts

Given a ~150 ns per-split saving, this is the expected outcome: the effect sits far below
the noise floor, so the sweeps measure drift rather than the change. Five of eight repeated
suites changed sign at least once, and the two that did not — ClickBench (−0.3/−1.0/−0.6)
and TPC-H SF=1 (+1.2/+1.1/+0.7) — held opposite signs. They cannot both be caused by a
change that provably removes work on the dominant path, so both are per-suite systematic
offsets, not signal.

Three specific failures of the methodology, each reproduced rather than asserted:

Baselines are not stable. Sweep 3 alone compared against six different bases —
0f0390a6, ad5de229, 74a2b861, 39fde8c1, 2b3109a8, adab5b84 — depending on the
suite.

A tight Parquet control does not bound Vortex-side variance. StatPopGen's control is
the tightest in the matrix (all eleven rows 0.98–1.01, geomean 1.001x), yet in that same
run q05 moved 1.25 🚨 and q10 moved 0.72 🚀. Host-wide drift cannot produce a 25% and a
28% swing under a 1% control.

The attribution step adds variance of its own. TPC-H SF=10's raw Vortex geomean was
0.998x, 1.002x, 0.996x across the three sweeps — stable and centred — while the
attributed figure swung −0.3% / +1.2% / −1.1% because the Parquet control drifted. In
sweep 3 that drift traces to one control row: tpch_q01/duckdb:parquet at 1.54.

The statpopgen_q10 history is the clearest single illustration. HEAD measured 2.94s,
3.12s, 3.09s across the three sweeps — a tight band. The baseline measured 4.26s,
2.88s, 4.27s — bimodal, and the anomalous value recurred to within 0.01s. The original
−6.0% reading was a slow baseline being read as a fast HEAD.

ClickBench Sorted is the loudest suite (+4.4%, and the only ❌ in the matrix) and also the
least usable: clickbench-sorted_q23 alone drives it, measuring 2.0× faster and 2.6×
slower on two formats within sweep 2, then 1.98× and 2.46× slower in sweep 3. Its
DataFusion Parquet control carries a 1.47 🚨, and its .vortex files differ between base
and HEAD — 100 larger, 100 smaller, up to ±2.3% per file — so the two sides decode
materially different bytes. That compressor nondeterminism recurs elsewhere: Euro2016 in
compress-bench differed by +18KB in sweep 2 and −234KB in sweep 3.

No SQL suite in any sweep showed a credible regression, and the lowest-noise ones read
zero: Appian NVMe +0.2% / −0.3% with every control row in 0.98–1.02, StatPopGen −0.1%
against a 1.001x control, FineWeb +0.0% where suite and control moved identically (1.003x
each).

The four S3 suites are excluded throughout: all flagged "environment too noisy", with
Parquet controls drifting −3.4%, −8.5% and −11.4%, one control row moving 5.34s → 0.85s,
and different baselines used across runs. Two sweep-3 examples show why they are excluded,
and both happen to point the favourable way:

  • FineWeb S3, attributed −7.9% off a Vortex geomean of 0.976x and a DuckDB Parquet
    control of 1.141x — where that control is set by a single row,
    fineweb_q06/duckdb:parquet, at 3.43 (1.57s → 5.39s) on a path this change cannot
    touch.
  • TPC-H SF=10 on S3, attributed −11.4% — the largest number anywhere in the matrix.
    Its DataFusion rows contradict themselves query by query within the one run:
    tpch_q04 measured 0.65 🚀 on vortex-compact and 1.62 🚨 on parquet; tpch_q06
    measured 0.71 and 1.33. Same query, same host, same run, opposite ~1.5x moves — and the
    Parquet side cannot be touched by this change at all. These are S3-bound queries whose
    cost is dominated by network IO, so a ~150 ns per-split saving cannot register at 11%.

Neither is evidence for this PR, and they are listed here so the two loudest favourable
numbers on the page are not mistaken for one.

Earlier revisions of this description made two claims that did not survive: local
microbenchmark numbers (clickbench_plan_perf, SCAN_VERSION=v1) of 6–9% at TPC-H SF=10,
and a correlation between sorted data layouts and favourable results. Both rested on single
measurements that reversed on repetition, and have been removed rather than reconciled.

Tests

Added test_stats_pruning_mask_zone_ranges, an rstest over row ranges covering only
pruned zones, only kept zones, a single pruned zone, a mixed partial range, and an empty
range — exercising both new fast paths and the unchanged expansion path.

What APIs are changed? Are there any user-facing changes?

None. ZonedReader::first_row_offset was a pub(crate) helper used only within this file;
it is now a private free function. No public API or behavior change.

Checks run

  • cargo test -p vortex-layout -p vortex-file — pass
  • cargo clippy -p vortex-layout --all-targets --all-features — clean
  • cargo +nightly fmt --all, git diff --check — clean
  • cargo bench -p vortex-layout --bench zone_mask_expansion — figures above

Not run: workspace-wide tests, Python/docs checks — the change is confined to one Rust file
plus a new bench target, with no public API surface.

@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Aug 7, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Aug 7, 2026
@joseph-isaacs joseph-isaacs added the changelog/performance A performance improvement label Aug 7, 2026 — with Claude
@codspeed-hq

codspeed-hq Bot commented Aug 7, 2026

Copy link
Copy Markdown

Merging this PR will improve performance by 13.05%

⚡ 1 improved benchmark
✅ 1933 untouched benchmarks
⏩ 51 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation decompress[u64, (1000, 16)] 73.9 µs 65.3 µs +13.05%

Tip

Curious why this is faster? Comment @codspeedbot explain why this is faster on this PR, or directly use the CodSpeed MCP with your agent.


Comparing claude/layoutreader-v1-scan-perf-0l1nci (adb75ed) with develop (39fde8c)

Open in CodSpeed

Footnotes

  1. 51 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

Copy link
Copy Markdown
Contributor Author

The CodSpeed regression is not reachable from this diff, so I'm not pushing a change for it.

Both flagged benchmarks live in vortex-array:

  • chunked_dict_primitive_into_canonicalvortex-array/benches/chunked_dict_builder.rs
  • chunked_varbin_opt_to_varbinview_buildervortex-array/benches/chunk_array_builder.rs

This PR modifies exactly one file, vortex-layout/src/layouts/zoned/reader.rs, and the dependency runs vortex-layoutvortex-array, never the reverse. vortex-array/Cargo.toml has no vortex-layout entry in [dependencies] or [dev-dependencies] (the only path dep there is vortex-array self-referencing itself for _test-harness), and nothing under vortex-array/ references vortex_layout at all. The vortex-array bench binaries built from BASE and HEAD are therefore identical — no changed code executes in either benchmark.

The shape of the report supports that reading: one benchmark −10.64% and another +10.01%, in Simulation mode, is the usual code/heap-layout artifact rather than a behavioral change.

Worth noting alongside this, from CodSpeed's own footnote: no successful run existed on develop (6a8d248) when the report was generated, so it compared against c1ae775 instead — "There might be some changes unrelated to this pull request in this report."

Leaving the acknowledgement on CodSpeed to a maintainer rather than dismissing it myself.


Generated by Claude Code

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 3062ebb tpch-s3-10 1 Explore Profiling Data
🟢 Done 3062ebb fineweb-s3 1 Explore Profiling Data
🟢 Done 3062ebb tpch-nvme-10 1 Explore Profiling Data
🟢 Done 3062ebb tpch-nvme 1 Explore Profiling Data
🟢 Done 3062ebb clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 3062ebb statpopgen 1 Explore Profiling Data
🟢 Done 3062ebb tpcds-nvme 1 Explore Profiling Data
🟢 Done 3062ebb clickbench-nvme 1 Explore Profiling Data
🟢 Done 3062ebb fineweb 1 Explore Profiling Data
🟢 Done 3062ebb polarsignals 1 Explore Profiling Data
🟢 Done 3062ebb appian-nvme 1 Explore Profiling Data
🟢 Done 3062ebb tpch-s3 1 Explore Profiling Data
🟢 Done 3062ebb random-access-bench 1 Explore Profiling Data
🟢 Done 3062ebb compress-bench 1 Explore Profiling Data
🟢 Done 3062ebb string-bench 1 Explore Profiling Data
Previous Runs (25)
Status Commit Job Attempt Link
🟢 Done ec8e480 fineweb-s3 1 Explore Profiling Data
🟢 Done ec8e480 tpch-nvme-10 1 Explore Profiling Data
🟢 Done ec8e480 clickbench-nvme 1 Explore Profiling Data
🟢 Done ec8e480 polarsignals 1 Explore Profiling Data
🟢 Done ec8e480 statpopgen 1 Explore Profiling Data
🟢 Done ec8e480 tpch-s3 1 Explore Profiling Data
🟢 Done ec8e480 appian-nvme 1 Explore Profiling Data
🟢 Done ec8e480 compress-bench 1 Explore Profiling Data
🟢 Done ec8e480 tpcds-nvme 1 Explore Profiling Data
🟢 Done ec8e480 tpch-nvme 1 Explore Profiling Data
🟢 Done ec8e480 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done ec8e480 tpch-s3-10 1 Explore Profiling Data
🟢 Done ec8e480 fineweb 1 Explore Profiling Data
🟢 Done ec8e480 random-access-bench 1 Explore Profiling Data
🟢 Done ec8e480 string-bench 1 Explore Profiling Data
🟢 Done 0fa9c84 statpopgen 1 Explore Profiling Data
🟢 Done 0fa9c84 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 0fa9c84 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 0fa9c84 fineweb-s3 1 Explore Profiling Data
🟢 Done 0fa9c84 fineweb 1 Explore Profiling Data
🟢 Done 0fa9c84 clickbench-nvme 1 Explore Profiling Data
🟢 Done 0fa9c84 tpcds-nvme 1 Explore Profiling Data
🟢 Done 0fa9c84 polarsignals 1 Explore Profiling Data
🟢 Done 0fa9c84 tpch-s3 1 Explore Profiling Data
🟢 Done 0fa9c84 tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Vortex (geomean): 1.017x ➖


datafusion / vortex-file-compressed / ns (1.017x ➖, 0↑ 1↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 🚨 134958775 121807718 1.11
polarsignals_q01/datafusion:vortex-file-compressed 163200393 162957995 1.00
polarsignals_q02/datafusion:vortex-file-compressed 21622436 20651023 1.05
polarsignals_q03/datafusion:vortex-file-compressed 163742738 162502359 1.01
polarsignals_q04/datafusion:vortex-file-compressed 10316990 10503660 0.98
polarsignals_q05/datafusion:vortex-file-compressed 13595493 13748768 0.99
polarsignals_q06/datafusion:vortex-file-compressed 23134071 21498080 1.08
polarsignals_q07/datafusion:vortex-file-compressed 11812992 11773454 1.00
polarsignals_q08/datafusion:vortex-file-compressed 281244729 274334617 1.03
polarsignals_q09/datafusion:vortex-file-compressed 10891475 11584715 0.94

No file size changes detected.

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.2%
Engines: DataFusion No clear signal (+0.8%, environment too noisy confidence) · DuckDB No clear signal (+1.5%, low confidence)
Vortex (geomean): 1.004x ➖
Parquet (geomean): 0.993x ➖
Shifts: Parquet (control) -0.7% · Median polish -0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 43890334 44414589 0.99
tpch_q02/datafusion:vortex-file-compressed 22731979 23209099 0.98
tpch_q03/datafusion:vortex-file-compressed 30200755 31417251 0.96
tpch_q04/datafusion:vortex-file-compressed 16217834 16021417 1.01
tpch_q05/datafusion:vortex-file-compressed 49438162 49630318 1.00
tpch_q06/datafusion:vortex-file-compressed 9106112 8719908 1.04
tpch_q07/datafusion:vortex-file-compressed 56927771 57504889 0.99
tpch_q08/datafusion:vortex-file-compressed 45028510 45794752 0.98
tpch_q09/datafusion:vortex-file-compressed 56563924 56919643 0.99
tpch_q10/datafusion:vortex-file-compressed 29183252 28941696 1.01
tpch_q11/datafusion:vortex-file-compressed 17777886 18020838 0.99
tpch_q12/datafusion:vortex-file-compressed 27659055 28739485 0.96
tpch_q13/datafusion:vortex-file-compressed 25083797 24755066 1.01
tpch_q14/datafusion:vortex-file-compressed 15081738 15600035 0.97
tpch_q15/datafusion:vortex-file-compressed 22339210 21340800 1.05
tpch_q16/datafusion:vortex-file-compressed 24675330 24822376 0.99
tpch_q17/datafusion:vortex-file-compressed 57448721 56636218 1.01
tpch_q18/datafusion:vortex-file-compressed 68111077 69112675 0.99
tpch_q19/datafusion:vortex-file-compressed 19104800 19524240 0.98
tpch_q20/datafusion:vortex-file-compressed 32250354 32078957 1.01
tpch_q21/datafusion:vortex-file-compressed 61928098 63763021 0.97
tpch_q22/datafusion:vortex-file-compressed 11923664 12141940 0.98
datafusion / parquet / ns (0.986x ➖, 1↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 110529961 110959660 1.00
tpch_q02/datafusion:parquet 70983408 71826642 0.99
tpch_q03/datafusion:parquet 105596791 97767476 1.08
tpch_q04/datafusion:parquet 51465117 49663137 1.04
tpch_q05/datafusion:parquet 117457961 129320596 0.91
tpch_q06/datafusion:parquet 48341697 45764371 1.06
tpch_q07/datafusion:parquet 128565597 130243125 0.99
tpch_q08/datafusion:parquet 130533052 132793893 0.98
tpch_q09/datafusion:parquet 158218022 163574092 0.97
tpch_q10/datafusion:parquet 118090802 127448561 0.93
tpch_q11/datafusion:parquet 50417211 51563492 0.98
tpch_q12/datafusion:parquet 106446877 104024886 1.02
tpch_q13/datafusion:parquet 227518543 228691980 0.99
tpch_q14/datafusion:parquet 53634665 51630967 1.04
tpch_q15/datafusion:parquet 70512691 68309382 1.03
tpch_q16/datafusion:parquet 48605804 49978430 0.97
tpch_q17/datafusion:parquet 158713600 159965030 0.99
tpch_q18/datafusion:parquet 180137208 182476582 0.99
tpch_q19/datafusion:parquet 🚀 70591424 86215924 0.82
tpch_q20/datafusion:parquet 91324546 95690770 0.95
tpch_q21/datafusion:parquet 172237534 174460664 0.99
tpch_q22/datafusion:parquet 57212893 56523365 1.01
duckdb / vortex-file-compressed / ns (1.015x ➖, 0↑ 1↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 24515525 24449389 1.00
tpch_q02/duckdb:vortex-file-compressed 37195030 36372246 1.02
tpch_q03/duckdb:vortex-file-compressed 39627575 39433287 1.00
tpch_q04/duckdb:vortex-file-compressed 33838294 34133985 0.99
tpch_q05/duckdb:vortex-file-compressed 45824817 46831378 0.98
tpch_q06/duckdb:vortex-file-compressed 13524725 13647218 0.99
tpch_q07/duckdb:vortex-file-compressed 43109034 46642064 0.92
tpch_q08/duckdb:vortex-file-compressed 55490524 55744843 1.00
tpch_q09/duckdb:vortex-file-compressed 62622813 59408289 1.05
tpch_q10/duckdb:vortex-file-compressed 55259104 55132299 1.00
tpch_q11/duckdb:vortex-file-compressed 19201912 19506182 0.98
tpch_q12/duckdb:vortex-file-compressed 31476437 30467342 1.03
tpch_q13/duckdb:vortex-file-compressed 46417347 46892438 0.99
tpch_q14/duckdb:vortex-file-compressed 22354007 23937711 0.93
tpch_q15/duckdb:vortex-file-compressed 🚨 21940129 19320639 1.14
tpch_q16/duckdb:vortex-file-compressed 33579555 32430982 1.04
tpch_q17/duckdb:vortex-file-compressed 34875137 34106315 1.02
tpch_q18/duckdb:vortex-file-compressed 55513459 51627039 1.08
tpch_q19/duckdb:vortex-file-compressed 39193460 38187046 1.03
tpch_q20/duckdb:vortex-file-compressed 40792753 39034322 1.05
tpch_q21/duckdb:vortex-file-compressed 131126576 125420563 1.05
tpch_q22/duckdb:vortex-file-compressed 23771148 22542370 1.05
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 81450930 81801073 1.00
tpch_q02/duckdb:parquet 46011970 46050501 1.00
tpch_q03/duckdb:parquet 80264602 81521115 0.98
tpch_q04/duckdb:parquet 57554778 57610784 1.00
tpch_q05/duckdb:parquet 78711014 78650137 1.00
tpch_q06/duckdb:parquet 24985970 24765269 1.01
tpch_q07/duckdb:parquet 79866263 79933191 1.00
tpch_q08/duckdb:parquet 96471894 96377068 1.00
tpch_q09/duckdb:parquet 148224846 148087352 1.00
tpch_q10/duckdb:parquet 141813935 142037547 1.00
tpch_q11/duckdb:parquet 25447955 25444267 1.00
tpch_q12/duckdb:parquet 53031598 53148733 1.00
tpch_q13/duckdb:parquet 284807496 286371974 0.99
tpch_q14/duckdb:parquet 56005856 56212657 1.00
tpch_q15/duckdb:parquet 30719872 30514566 1.01
tpch_q16/duckdb:parquet 66765376 67187982 0.99
tpch_q17/duckdb:parquet 57998342 57910627 1.00
tpch_q18/duckdb:parquet 128792094 126950908 1.01
tpch_q19/duckdb:parquet 77672495 77311681 1.00
tpch_q20/duckdb:parquet 77253616 77375512 1.00
tpch_q21/duckdb:parquet 188843603 189653246 1.00
tpch_q22/duckdb:parquet 64015707 64181213 1.00

File Size Changes (9 files changed, -43.9% overall, 0↑ 9↓)
File Scale Format Base HEAD Change %
customer.vortex 1.0 vortex-compact 7.40 MB 0 B 7.40 MB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem.vortex 1.0 vortex-compact 126.00 MB 0 B 126.00 MB -100.0%
nation.vortex 1.0 vortex-compact 8.04 KB 0 B 8.04 KB -100.0%
orders.vortex 1.0 vortex-compact 31.73 MB 0 B 31.73 MB -100.0%
part.vortex 1.0 vortex-compact 3.55 MB 0 B 3.55 MB -100.0%
partsupp.vortex 1.0 vortex-compact 20.29 MB 0 B 20.29 MB -100.0%
region.vortex 1.0 vortex-compact 6.09 KB 0 B 6.09 KB -100.0%
supplier.vortex 1.0 vortex-compact 496.71 KB 0 B 496.71 KB -100.0%

Totals:

  • vortex-compact: 189.73 MB → 0 B (-100.0%)
  • vortex-file-compressed: 242.85 MB → 242.85 MB (0.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.3%
Engines: DataFusion No clear signal (-1.3%, environment too noisy confidence) · DuckDB No clear signal (+8.1%, low confidence)
Vortex (geomean): 1.038x ➖
Parquet (geomean): 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.011x ➖, 0↑ 1↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 8509759 8987809 0.95
fineweb_q01/datafusion:vortex-file-compressed 🚨 32883901 27872242 1.18
fineweb_q02/datafusion:vortex-file-compressed 34055252 36075893 0.94
fineweb_q03/datafusion:vortex-file-compressed 40988102 41135728 1.00
fineweb_q04/datafusion:vortex-file-compressed 208017558 205557938 1.01
fineweb_q05/datafusion:vortex-file-compressed 162052639 153751523 1.05
fineweb_q06/datafusion:vortex-file-compressed 39044557 38570946 1.01
fineweb_q07/datafusion:vortex-file-compressed 43666941 43760962 1.00
fineweb_q08/datafusion:vortex-file-compressed 15899320 16300289 0.98
datafusion / parquet / ns (1.024x ➖, 0↑ 1↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 10362673 8798912 1.18
fineweb_q01/datafusion:parquet 204017801 199941702 1.02
fineweb_q02/datafusion:parquet 201427817 198990971 1.01
fineweb_q03/datafusion:parquet 191217084 193573730 0.99
fineweb_q04/datafusion:parquet 209220378 208498247 1.00
fineweb_q05/datafusion:parquet 205480909 205235164 1.00
fineweb_q06/datafusion:parquet 199151650 198147298 1.01
fineweb_q07/datafusion:parquet 194028507 192310415 1.01
fineweb_q08/datafusion:parquet 192184326 189632893 1.01
duckdb / vortex-file-compressed / ns (1.065x ➖, 0↑ 1↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 6148333 3574965 1.72
fineweb_q01/duckdb:vortex-file-compressed 47248923 43023175 1.10
fineweb_q02/duckdb:vortex-file-compressed 48286049 50881253 0.95
fineweb_q03/duckdb:vortex-file-compressed 68425575 72116310 0.95
fineweb_q04/duckdb:vortex-file-compressed 301935199 297452344 1.02
fineweb_q05/duckdb:vortex-file-compressed 221196843 225742568 0.98
fineweb_q06/duckdb:vortex-file-compressed 70563481 71941255 0.98
fineweb_q07/duckdb:vortex-file-compressed 78521047 79170206 0.99
fineweb_q08/duckdb:vortex-file-compressed 34441218 32111134 1.07
duckdb / parquet / ns (0.985x ➖, 0↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 36779378 39405619 0.93
fineweb_q01/duckdb:parquet 75314384 77348783 0.97
fineweb_q02/duckdb:parquet 78876308 78395962 1.01
fineweb_q03/duckdb:parquet 208453763 208537047 1.00
fineweb_q04/duckdb:parquet 232810310 238411924 0.98
fineweb_q05/duckdb:parquet 202672568 202172156 1.00
fineweb_q06/duckdb:parquet 143668405 143357514 1.00
fineweb_q07/duckdb:parquet 144323266 145558074 0.99
fineweb_q08/duckdb:parquet 38021006 38699691 0.98

File Size Changes (2 files changed, -46.3% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
sample.vortex 1.0 vortex-compact 1.23 GB 0 B 1.23 GB -100.0%

Totals:

  • vortex-compact: 1.23 GB → 0 B (-100.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (0.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.4%
Engines: DataFusion No clear signal (+0.3%, environment too noisy confidence) · DuckDB No clear signal (-3.0%, environment too noisy confidence)
Vortex (geomean): 0.983x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (0.993x ➖, 2↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 27109774 27760408 0.98
tpcds_q02/datafusion:vortex-file-compressed 51622325 53145015 0.97
tpcds_q03/datafusion:vortex-file-compressed 13756387 13736532 1.00
tpcds_q04/datafusion:vortex-file-compressed 222272882 217804764 1.02
tpcds_q05/datafusion:vortex-file-compressed 65009348 63953308 1.02
tpcds_q06/datafusion:vortex-file-compressed 26715067 26546119 1.01
tpcds_q07/datafusion:vortex-file-compressed 42162735 42808342 0.98
tpcds_q08/datafusion:vortex-file-compressed 33738328 33787516 1.00
tpcds_q09/datafusion:vortex-file-compressed 25782631 25953612 0.99
tpcds_q10/datafusion:vortex-file-compressed 36104705 36297976 0.99
tpcds_q11/datafusion:vortex-file-compressed 115730166 116683306 0.99
tpcds_q12/datafusion:vortex-file-compressed 20266565 20622854 0.98
tpcds_q13/datafusion:vortex-file-compressed 46329674 47474765 0.98
tpcds_q14/datafusion:vortex-file-compressed 209843603 203149589 1.03
tpcds_q15/datafusion:vortex-file-compressed 29495826 29450179 1.00
tpcds_q16/datafusion:vortex-file-compressed 24144879 24773240 0.97
tpcds_q17/datafusion:vortex-file-compressed 74734221 71944233 1.04
tpcds_q18/datafusion:vortex-file-compressed 87069189 88529362 0.98
tpcds_q19/datafusion:vortex-file-compressed 21638844 21694666 1.00
tpcds_q20/datafusion:vortex-file-compressed 23970850 25206365 0.95
tpcds_q21/datafusion:vortex-file-compressed 33464391 32737189 1.02
tpcds_q22/datafusion:vortex-file-compressed 🚀 102765830 124795325 0.82
tpcds_q23/datafusion:vortex-file-compressed 130728906 130716884 1.00
tpcds_q24/datafusion:vortex-file-compressed 95364952 95107609 1.00
tpcds_q25/datafusion:vortex-file-compressed 72876570 73621955 0.99
tpcds_q26/datafusion:vortex-file-compressed 37049783 37125206 1.00
tpcds_q27/datafusion:vortex-file-compressed 94327680 93572285 1.01
tpcds_q28/datafusion:vortex-file-compressed 28732344 29142836 0.99
tpcds_q29/datafusion:vortex-file-compressed 70364717 69207440 1.02
tpcds_q30/datafusion:vortex-file-compressed 30273754 29420803 1.03
tpcds_q31/datafusion:vortex-file-compressed 76897479 75761623 1.01
tpcds_q32/datafusion:vortex-file-compressed 18183563 18109214 1.00
tpcds_q33/datafusion:vortex-file-compressed 32640407 32672641 1.00
tpcds_q34/datafusion:vortex-file-compressed 26084124 25980150 1.00
tpcds_q35/datafusion:vortex-file-compressed 44488981 46160941 0.96
tpcds_q36/datafusion:vortex-file-compressed 64387334 66030489 0.98
tpcds_q37/datafusion:vortex-file-compressed 17464315 18395560 0.95
tpcds_q38/datafusion:vortex-file-compressed 38391687 39379787 0.97
tpcds_q39/datafusion:vortex-file-compressed 97584104 100107351 0.97
tpcds_q40/datafusion:vortex-file-compressed 33471325 32796900 1.02
tpcds_q41/datafusion:vortex-file-compressed 24510997 24047946 1.02
tpcds_q42/datafusion:vortex-file-compressed 13793429 13639157 1.01
tpcds_q43/datafusion:vortex-file-compressed 18972672 19309111 0.98
tpcds_q44/datafusion:vortex-file-compressed 34230055 35877012 0.95
tpcds_q45/datafusion:vortex-file-compressed 32591593 33178892 0.98
tpcds_q46/datafusion:vortex-file-compressed 33997109 35536815 0.96
tpcds_q47/datafusion:vortex-file-compressed 130495302 128544388 1.02
tpcds_q48/datafusion:vortex-file-compressed 38359252 39056957 0.98
tpcds_q49/datafusion:vortex-file-compressed 71550378 72186045 0.99
tpcds_q50/datafusion:vortex-file-compressed 45659076 47345370 0.96
tpcds_q51/datafusion:vortex-file-compressed 76539780 75641940 1.01
tpcds_q52/datafusion:vortex-file-compressed 14440721 14058998 1.03
tpcds_q53/datafusion:vortex-file-compressed 24441938 24029790 1.02
tpcds_q54/datafusion:vortex-file-compressed 37584881 37341353 1.01
tpcds_q55/datafusion:vortex-file-compressed 13787150 13762742 1.00
tpcds_q56/datafusion:vortex-file-compressed 33993496 33164543 1.02
tpcds_q57/datafusion:vortex-file-compressed 98457360 100316871 0.98
tpcds_q58/datafusion:vortex-file-compressed 61365984 61526178 1.00
tpcds_q59/datafusion:vortex-file-compressed 55975904 56090102 1.00
tpcds_q60/datafusion:vortex-file-compressed 32401658 32307530 1.00
tpcds_q61/datafusion:vortex-file-compressed 36752899 36423823 1.01
tpcds_q62/datafusion:vortex-file-compressed 🚀 21822657 25266801 0.86
tpcds_q63/datafusion:vortex-file-compressed 24064406 24710423 0.97
tpcds_q64/datafusion:vortex-file-compressed 511889458 486660987 1.05
tpcds_q65/datafusion:vortex-file-compressed 75117683 74575111 1.01
tpcds_q66/datafusion:vortex-file-compressed 78765954 78013202 1.01
tpcds_q67/datafusion:vortex-file-compressed 114501569 114529014 1.00
tpcds_q68/datafusion:vortex-file-compressed 32893985 34159110 0.96
tpcds_q69/datafusion:vortex-file-compressed 34637197 33601555 1.03
tpcds_q70/datafusion:vortex-file-compressed 116686022 110429003 1.06
tpcds_q71/datafusion:vortex-file-compressed 22934067 23967039 0.96
tpcds_q72/datafusion:vortex-file-compressed 1466953806 1464597136 1.00
tpcds_q73/datafusion:vortex-file-compressed 24576862 24497690 1.00
tpcds_q74/datafusion:vortex-file-compressed 76928554 76083441 1.01
tpcds_q75/datafusion:vortex-file-compressed 139763472 141085545 0.99
tpcds_q76/datafusion:vortex-file-compressed 42485576 42465362 1.00
tpcds_q77/datafusion:vortex-file-compressed 44722951 45215130 0.99
tpcds_q78/datafusion:vortex-file-compressed 108467703 108300751 1.00
tpcds_q79/datafusion:vortex-file-compressed 27782448 28506640 0.97
tpcds_q80/datafusion:vortex-file-compressed 101380053 101142196 1.00
tpcds_q81/datafusion:vortex-file-compressed 30296824 30884549 0.98
tpcds_q82/datafusion:vortex-file-compressed 19653390 19378126 1.01
tpcds_q83/datafusion:vortex-file-compressed 41767330 43780573 0.95
tpcds_q84/datafusion:vortex-file-compressed 13402647 13208891 1.01
tpcds_q85/datafusion:vortex-file-compressed 111989685 112681949 0.99
tpcds_q86/datafusion:vortex-file-compressed 18432355 19371281 0.95
tpcds_q87/datafusion:vortex-file-compressed 42368969 41816556 1.01
tpcds_q88/datafusion:vortex-file-compressed 52377853 52963929 0.99
tpcds_q89/datafusion:vortex-file-compressed 27237752 27978794 0.97
tpcds_q90/datafusion:vortex-file-compressed 13992369 14614090 0.96
tpcds_q91/datafusion:vortex-file-compressed 19993784 20591041 0.97
tpcds_q92/datafusion:vortex-file-compressed 17519957 16610956 1.05
tpcds_q93/datafusion:vortex-file-compressed 31119491 31709063 0.98
tpcds_q94/datafusion:vortex-file-compressed 24512544 24310407 1.01
tpcds_q95/datafusion:vortex-file-compressed 62713196 62802366 1.00
tpcds_q96/datafusion:vortex-file-compressed 11371096 10997613 1.03
tpcds_q97/datafusion:vortex-file-compressed 29327326 28562949 1.03
tpcds_q98/datafusion:vortex-file-compressed 24743174 24883484 0.99
tpcds_q99/datafusion:vortex-file-compressed 28017295 27697558 1.01
datafusion / parquet / ns (0.991x ➖, 3↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 31755503 31376510 1.01
tpcds_q02/datafusion:parquet 52855157 52640671 1.00
tpcds_q03/datafusion:parquet 17560601 17413015 1.01
tpcds_q04/datafusion:parquet 337951170 336116189 1.01
tpcds_q05/datafusion:parquet 81986861 78617748 1.04
tpcds_q06/datafusion:parquet 31767911 30967330 1.03
tpcds_q07/datafusion:parquet 98790156 96189137 1.03
tpcds_q08/datafusion:parquet 37262776 38376830 0.97
tpcds_q09/datafusion:parquet 34649709 36674088 0.94
tpcds_q10/datafusion:parquet 89191638 87181029 1.02
tpcds_q11/datafusion:parquet 173911622 172374521 1.01
tpcds_q12/datafusion:parquet 23838945 22506873 1.06
tpcds_q13/datafusion:parquet 100529851 98888279 1.02
tpcds_q14/datafusion:parquet 279807183 273511451 1.02
tpcds_q15/datafusion:parquet 35503733 36400280 0.98
tpcds_q16/datafusion:parquet 47753968 49714996 0.96
tpcds_q17/datafusion:parquet 108801464 107935468 1.01
tpcds_q18/datafusion:parquet 136225749 130898523 1.04
tpcds_q19/datafusion:parquet 28932405 28312761 1.02
tpcds_q20/datafusion:parquet 24015863 23397085 1.03
tpcds_q21/datafusion:parquet 22504436 22202519 1.01
tpcds_q22/datafusion:parquet 🚀 104887619 133644412 0.78
tpcds_q23/datafusion:parquet 176779451 175764025 1.01
tpcds_q24/datafusion:parquet 139211625 152997914 0.91
tpcds_q25/datafusion:parquet 107145584 110225863 0.97
tpcds_q26/datafusion:parquet 85571291 88403052 0.97
tpcds_q27/datafusion:parquet 158997928 165770293 0.96
tpcds_q28/datafusion:parquet 41753365 40597850 1.03
tpcds_q29/datafusion:parquet 108561459 107618990 1.01
tpcds_q30/datafusion:parquet 43042650 45537976 0.95
tpcds_q31/datafusion:parquet 92190991 93955603 0.98
tpcds_q32/datafusion:parquet 23793447 24050259 0.99
tpcds_q33/datafusion:parquet 37492384 37862678 0.99
tpcds_q34/datafusion:parquet 31306804 30046598 1.04
tpcds_q35/datafusion:parquet 92015828 89630749 1.03
tpcds_q36/datafusion:parquet 69852190 69903256 1.00
tpcds_q37/datafusion:parquet 24343584 24008134 1.01
tpcds_q38/datafusion:parquet 58902021 56897632 1.04
tpcds_q39/datafusion:parquet 83746937 84333654 0.99
tpcds_q40/datafusion:parquet 34022876 34921754 0.97
tpcds_q41/datafusion:parquet 19400657 19082489 1.02
tpcds_q42/datafusion:parquet 16499462 16169417 1.02
tpcds_q43/datafusion:parquet 22916731 23063794 0.99
tpcds_q44/datafusion:parquet 41358424 39880793 1.04
tpcds_q45/datafusion:parquet 44923706 46707479 0.96
tpcds_q46/datafusion:parquet 41684119 42711326 0.98
tpcds_q47/datafusion:parquet 150091842 150982191 0.99
tpcds_q48/datafusion:parquet 87977320 88192222 1.00
tpcds_q49/datafusion:parquet 78010145 80418442 0.97
tpcds_q50/datafusion:parquet 72665376 74370363 0.98
tpcds_q51/datafusion:parquet 81351004 80199576 1.01
tpcds_q52/datafusion:parquet 16566281 18269291 0.91
tpcds_q53/datafusion:parquet 25369018 25468290 1.00
tpcds_q54/datafusion:parquet 46271846 46843010 0.99
tpcds_q55/datafusion:parquet 16036628 16005535 1.00
tpcds_q56/datafusion:parquet 36603329 36762952 1.00
tpcds_q57/datafusion:parquet 135225707 124047801 1.09
tpcds_q58/datafusion:parquet 82180388 81975073 1.00
tpcds_q59/datafusion:parquet 75843730 77804072 0.97
tpcds_q60/datafusion:parquet 36385691 37055534 0.98
tpcds_q61/datafusion:parquet 45461724 47732734 0.95
tpcds_q62/datafusion:parquet 🚀 27297990 34563902 0.79
tpcds_q63/datafusion:parquet 24844573 25037863 0.99
tpcds_q64/datafusion:parquet 363795676 354940306 1.02
tpcds_q65/datafusion:parquet 53938988 49260361 1.09
tpcds_q66/datafusion:parquet 84494346 87270469 0.97
tpcds_q67/datafusion:parquet 144401071 144090605 1.00
tpcds_q68/datafusion:parquet 40126867 39972952 1.00
tpcds_q69/datafusion:parquet 83360877 89124036 0.94
tpcds_q70/datafusion:parquet 44435185 44795423 0.99
tpcds_q71/datafusion:parquet 26929125 26762402 1.01
tpcds_q72/datafusion:parquet 449332242 448311926 1.00
tpcds_q73/datafusion:parquet 27523854 28267668 0.97
tpcds_q74/datafusion:parquet 101358038 102528254 0.99
tpcds_q75/datafusion:parquet 181387149 171703484 1.06
tpcds_q76/datafusion:parquet 61943459 61542697 1.01
tpcds_q77/datafusion:parquet 55586982 57097381 0.97
tpcds_q78/datafusion:parquet 129160092 124519724 1.04
tpcds_q79/datafusion:parquet 34177505 36286329 0.94
tpcds_q80/datafusion:parquet 97275026 97024274 1.00
tpcds_q81/datafusion:parquet 38622707 38494536 1.00
tpcds_q82/datafusion:parquet 23576747 24961945 0.94
tpcds_q83/datafusion:parquet 59030472 56689216 1.04
tpcds_q84/datafusion:parquet 48254385 47689549 1.01
tpcds_q85/datafusion:parquet 193618199 195867880 0.99
tpcds_q86/datafusion:parquet 20832153 21058427 0.99
tpcds_q87/datafusion:parquet 62390178 61432407 1.02
tpcds_q88/datafusion:parquet 58681487 59449158 0.99
tpcds_q89/datafusion:parquet 30243689 29646918 1.02
tpcds_q90/datafusion:parquet 19193008 18728280 1.02
tpcds_q91/datafusion:parquet 64829766 64812145 1.00
tpcds_q92/datafusion:parquet 24939043 26870130 0.93
tpcds_q93/datafusion:parquet 35620078 38017612 0.94
tpcds_q94/datafusion:parquet 30792876 30109511 1.02
tpcds_q95/datafusion:parquet 86653558 89420286 0.97
tpcds_q96/datafusion:parquet 16693147 16633474 1.00
tpcds_q97/datafusion:parquet 39892695 40130983 0.99
tpcds_q98/datafusion:parquet 27195066 26420382 1.03
tpcds_q99/datafusion:parquet 🚀 33874396 41651263 0.81
duckdb / vortex-file-compressed / ns (0.973x ➖, 10↑ 2↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 28575242 29938037 0.95
tpcds_q02/duckdb:vortex-file-compressed 29020584 31186257 0.93
tpcds_q03/duckdb:vortex-file-compressed 23136939 22417541 1.03
tpcds_q04/duckdb:vortex-file-compressed 99130223 98493898 1.01
tpcds_q05/duckdb:vortex-file-compressed 41396093 44002448 0.94
tpcds_q06/duckdb:vortex-file-compressed 50621431 52836144 0.96
tpcds_q07/duckdb:vortex-file-compressed 29836721 31444397 0.95
tpcds_q08/duckdb:vortex-file-compressed 33378941 34725467 0.96
tpcds_q09/duckdb:vortex-file-compressed 🚨 22670035 19211187 1.18
tpcds_q10/duckdb:vortex-file-compressed 55927249 56907432 0.98
tpcds_q11/duckdb:vortex-file-compressed 73458454 75205435 0.98
tpcds_q12/duckdb:vortex-file-compressed 18201623 18894771 0.96
tpcds_q13/duckdb:vortex-file-compressed 39252840 42100276 0.93
tpcds_q14/duckdb:vortex-file-compressed 115981366 113135090 1.03
tpcds_q15/duckdb:vortex-file-compressed 36747777 36782571 1.00
tpcds_q16/duckdb:vortex-file-compressed 32729144 33844621 0.97
tpcds_q17/duckdb:vortex-file-compressed 55461120 58499565 0.95
tpcds_q18/duckdb:vortex-file-compressed 51952147 50700689 1.02
tpcds_q19/duckdb:vortex-file-compressed 40524937 43015429 0.94
tpcds_q20/duckdb:vortex-file-compressed 18270971 18376438 0.99
tpcds_q21/duckdb:vortex-file-compressed 22138808 23547816 0.94
tpcds_q22/duckdb:vortex-file-compressed 65333525 68262874 0.96
tpcds_q23/duckdb:vortex-file-compressed 74547488 77880535 0.96
tpcds_q24/duckdb:vortex-file-compressed 51071344 52466120 0.97
tpcds_q25/duckdb:vortex-file-compressed 48909277 51919533 0.94
tpcds_q26/duckdb:vortex-file-compressed 🚀 23597705 26323658 0.90
tpcds_q27/duckdb:vortex-file-compressed 36149257 36274813 1.00
tpcds_q28/duckdb:vortex-file-compressed 16336490 15365592 1.06
tpcds_q29/duckdb:vortex-file-compressed 58159899 56266157 1.03
tpcds_q30/duckdb:vortex-file-compressed 37725678 36297438 1.04
tpcds_q31/duckdb:vortex-file-compressed 34837846 37644909 0.93
tpcds_q32/duckdb:vortex-file-compressed 🚨 22792480 19835771 1.15
tpcds_q33/duckdb:vortex-file-compressed 35000702 35398562 0.99
tpcds_q34/duckdb:vortex-file-compressed 34630618 32907285 1.05
tpcds_q35/duckdb:vortex-file-compressed 85615958 85729634 1.00
tpcds_q36/duckdb:vortex-file-compressed 30446987 32324603 0.94
tpcds_q37/duckdb:vortex-file-compressed 🚀 26847573 30168306 0.89
tpcds_q38/duckdb:vortex-file-compressed 42914332 41867427 1.03
tpcds_q39/duckdb:vortex-file-compressed 36097679 35472118 1.02
tpcds_q40/duckdb:vortex-file-compressed 23411047 21679598 1.08
tpcds_q41/duckdb:vortex-file-compressed 19296080 20626477 0.94
tpcds_q42/duckdb:vortex-file-compressed 18492069 18009678 1.03
tpcds_q43/duckdb:vortex-file-compressed 22474262 22015809 1.02
tpcds_q44/duckdb:vortex-file-compressed 🚀 24312637 28204681 0.86
tpcds_q45/duckdb:vortex-file-compressed 37233914 39179401 0.95
tpcds_q46/duckdb:vortex-file-compressed 40277006 42863962 0.94
tpcds_q47/duckdb:vortex-file-compressed 57245870 61113454 0.94
tpcds_q48/duckdb:vortex-file-compressed 34794649 38448012 0.90
tpcds_q49/duckdb:vortex-file-compressed 41555094 42152928 0.99
tpcds_q50/duckdb:vortex-file-compressed 33031213 34729035 0.95
tpcds_q51/duckdb:vortex-file-compressed 111376511 115042195 0.97
tpcds_q52/duckdb:vortex-file-compressed 18279669 17087409 1.07
tpcds_q53/duckdb:vortex-file-compressed 30883204 30166728 1.02
tpcds_q54/duckdb:vortex-file-compressed 48290691 49134057 0.98
tpcds_q55/duckdb:vortex-file-compressed 🚀 16518574 19781943 0.84
tpcds_q56/duckdb:vortex-file-compressed 30889215 32667482 0.95
tpcds_q57/duckdb:vortex-file-compressed 43627865 45634676 0.96
tpcds_q58/duckdb:vortex-file-compressed 39619803 40224950 0.98
tpcds_q59/duckdb:vortex-file-compressed 39728107 39573527 1.00
tpcds_q60/duckdb:vortex-file-compressed 36476738 37865141 0.96
tpcds_q61/duckdb:vortex-file-compressed 39167031 40699531 0.96
tpcds_q62/duckdb:vortex-file-compressed 19677449 18323338 1.07
tpcds_q63/duckdb:vortex-file-compressed 🚀 25024149 31410327 0.80
tpcds_q64/duckdb:vortex-file-compressed 113199670 118207622 0.96
tpcds_q65/duckdb:vortex-file-compressed 🚀 27384831 32264315 0.85
tpcds_q66/duckdb:vortex-file-compressed 37949150 38984639 0.97
tpcds_q67/duckdb:vortex-file-compressed 130161668 139097777 0.94
tpcds_q68/duckdb:vortex-file-compressed 39868885 38953620 1.02
tpcds_q69/duckdb:vortex-file-compressed 59835621 57363219 1.04
tpcds_q70/duckdb:vortex-file-compressed 42044937 41797115 1.01
tpcds_q71/duckdb:vortex-file-compressed 24818579 25895063 0.96
tpcds_q72/duckdb:vortex-file-compressed 149576986 153155801 0.98
tpcds_q73/duckdb:vortex-file-compressed 29980740 30374484 0.99
tpcds_q74/duckdb:vortex-file-compressed 51283104 52974320 0.97
tpcds_q75/duckdb:vortex-file-compressed 60426606 59216473 1.02
tpcds_q76/duckdb:vortex-file-compressed 🚀 24202511 28711301 0.84
tpcds_q77/duckdb:vortex-file-compressed 🚀 31415784 35558914 0.88
tpcds_q78/duckdb:vortex-file-compressed 83086316 78362644 1.06
tpcds_q79/duckdb:vortex-file-compressed 29991346 31319841 0.96
tpcds_q80/duckdb:vortex-file-compressed 57615463 60202437 0.96
tpcds_q81/duckdb:vortex-file-compressed 42749495 42235008 1.01
tpcds_q82/duckdb:vortex-file-compressed 56741770 54681860 1.04
tpcds_q83/duckdb:vortex-file-compressed 43660676 43294318 1.01
tpcds_q84/duckdb:vortex-file-compressed 26747100 28041030 0.95
tpcds_q85/duckdb:vortex-file-compressed 56489841 56721888 1.00
tpcds_q86/duckdb:vortex-file-compressed 19897892 19301096 1.03
tpcds_q87/duckdb:vortex-file-compressed 48225323 50287235 0.96
tpcds_q88/duckdb:vortex-file-compressed 65557976 61894072 1.06
tpcds_q89/duckdb:vortex-file-compressed 27016308 29505149 0.92
tpcds_q90/duckdb:vortex-file-compressed 16908942 17582495 0.96
tpcds_q91/duckdb:vortex-file-compressed 34662611 34589575 1.00
tpcds_q92/duckdb:vortex-file-compressed 25282412 26517666 0.95
tpcds_q93/duckdb:vortex-file-compressed 30031044 31280172 0.96
tpcds_q94/duckdb:vortex-file-compressed 32366490 34321342 0.94
tpcds_q95/duckdb:vortex-file-compressed 138510029 152689385 0.91
tpcds_q96/duckdb:vortex-file-compressed 🚀 15796719 18666651 0.85
tpcds_q97/duckdb:vortex-file-compressed 43434692 42883576 1.01
tpcds_q98/duckdb:vortex-file-compressed 🚀 23793061 26511992 0.90
tpcds_q99/duckdb:vortex-file-compressed 26296092 26447209 0.99
duckdb / parquet / ns (1.003x ➖, 3↑ 6↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 31223040 32913984 0.95
tpcds_q02/duckdb:parquet 🚨 25244161 21514532 1.17
tpcds_q03/duckdb:parquet 🚨 14052368 12515182 1.12
tpcds_q04/duckdb:parquet 195788220 199332111 0.98
tpcds_q05/duckdb:parquet 32424330 32924948 0.98
tpcds_q06/duckdb:parquet 35366008 36056373 0.98
tpcds_q07/duckdb:parquet 23326429 22373580 1.04
tpcds_q08/duckdb:parquet 33334092 32924998 1.01
tpcds_q09/duckdb:parquet 30668781 30337464 1.01
tpcds_q10/duckdb:parquet 41320599 40650211 1.02
tpcds_q11/duckdb:parquet 101917928 100447694 1.01
tpcds_q12/duckdb:parquet 17543770 17478656 1.00
tpcds_q13/duckdb:parquet 35268665 34791678 1.01
tpcds_q14/duckdb:parquet 104252739 107815339 0.97
tpcds_q15/duckdb:parquet 35736999 34798677 1.03
tpcds_q16/duckdb:parquet 28003590 27628569 1.01
tpcds_q17/duckdb:parquet 45277266 44924166 1.01
tpcds_q18/duckdb:parquet 56172564 55534088 1.01
tpcds_q19/duckdb:parquet 33421315 33595366 0.99
tpcds_q20/duckdb:parquet 19312700 19340529 1.00
tpcds_q21/duckdb:parquet 14244799 14310756 1.00
tpcds_q22/duckdb:parquet 51376421 50179002 1.02
tpcds_q23/duckdb:parquet 68919496 71589252 0.96
tpcds_q24/duckdb:parquet 47878009 48305076 0.99
tpcds_q25/duckdb:parquet 42388093 41679544 1.02
tpcds_q26/duckdb:parquet 44144406 45457428 0.97
tpcds_q27/duckdb:parquet 54427662 54482965 1.00
tpcds_q28/duckdb:parquet 31980495 31113582 1.03
tpcds_q29/duckdb:parquet 42655553 42341711 1.01
tpcds_q30/duckdb:parquet 43090219 43548211 0.99
tpcds_q31/duckdb:parquet 29630907 28591370 1.04
tpcds_q32/duckdb:parquet 15292986 15207159 1.01
tpcds_q33/duckdb:parquet 23121555 23397945 0.99
tpcds_q34/duckdb:parquet 21512587 21815019 0.99
tpcds_q35/duckdb:parquet 68065716 66989353 1.02
tpcds_q36/duckdb:parquet 21971005 22262195 0.99
tpcds_q37/duckdb:parquet 17895771 17215535 1.04
tpcds_q38/duckdb:parquet 40628007 40821886 1.00
tpcds_q39/duckdb:parquet 37109987 37493861 0.99
tpcds_q40/duckdb:parquet 22814166 22823824 1.00
tpcds_q41/duckdb:parquet 10151672 10648587 0.95
tpcds_q42/duckdb:parquet 12894206 13046573 0.99
tpcds_q43/duckdb:parquet 🚀 14495934 19022713 0.76
tpcds_q44/duckdb:parquet 24123154 24268040 0.99
tpcds_q45/duckdb:parquet 32938593 31869071 1.03
tpcds_q46/duckdb:parquet 51434617 50531498 1.02
tpcds_q47/duckdb:parquet 47663051 49746373 0.96
tpcds_q48/duckdb:parquet 29962082 29915312 1.00
tpcds_q49/duckdb:parquet 28882862 28271370 1.02
tpcds_q50/duckdb:parquet 24915160 24499301 1.02
tpcds_q51/duckdb:parquet 96128520 102823748 0.93
tpcds_q52/duckdb:parquet 12114736 13143944 0.92
tpcds_q53/duckdb:parquet 15998550 15787072 1.01
tpcds_q54/duckdb:parquet 30418481 29230196 1.04
tpcds_q55/duckdb:parquet 🚨 13057227 11707337 1.12
tpcds_q56/duckdb:parquet 24044388 25555012 0.94
tpcds_q57/duckdb:parquet 42884970 42340218 1.01
tpcds_q58/duckdb:parquet 26996952 26989614 1.00
tpcds_q59/duckdb:parquet 30096551 29394576 1.02
tpcds_q60/duckdb:parquet 26049616 26300122 0.99
tpcds_q61/duckdb:parquet 33848354 33649261 1.01
tpcds_q62/duckdb:parquet 14744777 14698430 1.00
tpcds_q63/duckdb:parquet 🚀 15168030 16962103 0.89
tpcds_q64/duckdb:parquet 80678395 80810563 1.00
tpcds_q65/duckdb:parquet 22280682 22096961 1.01
tpcds_q66/duckdb:parquet 34472404 34593946 1.00
tpcds_q67/duckdb:parquet 128506914 124781229 1.03
tpcds_q68/duckdb:parquet 38740334 40362656 0.96
tpcds_q69/duckdb:parquet 41930512 41667032 1.01
tpcds_q70/duckdb:parquet 28424868 26899928 1.06
tpcds_q71/duckdb:parquet 21718088 21893651 0.99
tpcds_q72/duckdb:parquet 🚨 179542382 147764004 1.22
tpcds_q73/duckdb:parquet 🚀 18955394 21552724 0.88
tpcds_q74/duckdb:parquet 145046544 144557638 1.00
tpcds_q75/duckdb:parquet 60357316 60280966 1.00
tpcds_q76/duckdb:parquet 19268940 19436754 0.99
tpcds_q77/duckdb:parquet 24307226 25454296 0.95
tpcds_q78/duckdb:parquet 77482184 78145367 0.99
tpcds_q79/duckdb:parquet 🚨 30672416 27330593 1.12
tpcds_q80/duckdb:parquet 46597223 49455358 0.94
tpcds_q81/duckdb:parquet 41835574 40191420 1.04
tpcds_q82/duckdb:parquet 18505741 19102770 0.97
tpcds_q83/duckdb:parquet 22649785 21879846 1.04
tpcds_q84/duckdb:parquet 23785882 23799704 1.00
tpcds_q85/duckdb:parquet 47785008 47075652 1.02
tpcds_q86/duckdb:parquet 15128157 15317765 0.99
tpcds_q87/duckdb:parquet 44466287 44218486 1.01
tpcds_q88/duckdb:parquet 43602277 42609937 1.02
tpcds_q89/duckdb:parquet 🚨 20319497 17985233 1.13
tpcds_q90/duckdb:parquet 9639366 10431590 0.92
tpcds_q91/duckdb:parquet 26691521 26857998 0.99
tpcds_q92/duckdb:parquet 15610414 15574018 1.00
tpcds_q93/duckdb:parquet 35288091 34794687 1.01
tpcds_q94/duckdb:parquet 21895904 21749839 1.01
tpcds_q95/duckdb:parquet 136701687 138198001 0.99
tpcds_q96/duckdb:parquet 11024809 10121017 1.09
tpcds_q97/duckdb:parquet 39828326 39154388 1.02
tpcds_q98/duckdb:parquet 21600859 21444319 1.01
tpcds_q99/duckdb:parquet 23288433 23385173 1.00

File Size Changes (25 files changed, -43.5% overall, 0↑ 25↓)
File Scale Format Base HEAD Change %
call_center.vortex 1.0 vortex-compact 47.68 KB 0 B 47.68 KB -100.0%
catalog_page.vortex 1.0 vortex-compact 362.70 KB 0 B 362.70 KB -100.0%
catalog_returns.vortex 1.0 vortex-compact 6.04 MB 0 B 6.04 MB -100.0%
catalog_sales.vortex 1.0 vortex-compact 59.49 MB 0 B 59.49 MB -100.0%
customer.vortex 1.0 vortex-compact 3.29 MB 0 B 3.29 MB -100.0%
customer_address.vortex 1.0 vortex-compact 639.07 KB 0 B 639.07 KB -100.0%
customer_demographics.vortex 1.0 vortex-compact 424.41 KB 0 B 424.41 KB -100.0%
date_dim.vortex 1.0 vortex-compact 140.51 KB 0 B 140.51 KB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
household_demographics.vortex 1.0 vortex-compact 10.52 KB 0 B 10.52 KB -100.0%
income_band.vortex 1.0 vortex-compact 5.80 KB 0 B 5.80 KB -100.0%
inventory.vortex 1.0 vortex-compact 16.07 MB 0 B 16.07 MB -100.0%
item.vortex 1.0 vortex-compact 1000.57 KB 0 B 1000.57 KB -100.0%
promotion.vortex 1.0 vortex-compact 50.55 KB 0 B 50.55 KB -100.0%
reason.vortex 1.0 vortex-compact 6.20 KB 0 B 6.20 KB -100.0%
ship_mode.vortex 1.0 vortex-compact 10.96 KB 0 B 10.96 KB -100.0%
store.vortex 1.0 vortex-compact 43.47 KB 0 B 43.47 KB -100.0%
store_returns.vortex 1.0 vortex-compact 9.36 MB 0 B 9.36 MB -100.0%
store_sales.vortex 1.0 vortex-compact 78.12 MB 0 B 78.12 MB -100.0%
time_dim.vortex 1.0 vortex-compact 96.83 KB 0 B 96.83 KB -100.0%
warehouse.vortex 1.0 vortex-compact 22.38 KB 0 B 22.38 KB -100.0%
web_page.vortex 1.0 vortex-compact 25.24 KB 0 B 25.24 KB -100.0%
web_returns.vortex 1.0 vortex-compact 3.00 MB 0 B 3.00 MB -100.0%
web_sales.vortex 1.0 vortex-compact 29.45 MB 0 B 29.45 MB -100.0%
web_site.vortex 1.0 vortex-compact 42.43 KB 0 B 42.43 KB -100.0%

Totals:

  • vortex-compact: 207.95 MB → 0 B (-100.0%)
  • vortex-file-compressed: 269.98 MB → 269.98 MB (0.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.8%
Engines: DataFusion No clear signal (-4.0%, environment too noisy confidence) · DuckDB No clear signal (-1.6%, low confidence)
Vortex (geomean): 0.984x ➖
Parquet (geomean): 1.013x ➖
Shifts: Parquet (control) +1.3% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (0.985x ➖, 0↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:vortex-file-compressed 446437936 487902822 0.92
clickbench-sorted_q24/datafusion:vortex-file-compressed 22168301 22897827 0.97
clickbench-sorted_q26/datafusion:vortex-file-compressed 23624467 22378832 1.06
clickbench-sorted_q36/datafusion:vortex-file-compressed 49145264 49457893 0.99
clickbench-sorted_q37/datafusion:vortex-file-compressed 38588605 39001218 0.99
clickbench-sorted_q38/datafusion:vortex-file-compressed 39985341 42188844 0.95
clickbench-sorted_q39/datafusion:vortex-file-compressed 90704060 88297347 1.03
clickbench-sorted_q40/datafusion:vortex-file-compressed 17426182 17830731 0.98
clickbench-sorted_q41/datafusion:vortex-file-compressed 16938936 17307721 0.98
clickbench-sorted_q42/datafusion:vortex-file-compressed 13392730 13378946 1.00
datafusion / parquet / ns (1.026x ➖, 0↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:parquet 2930711973 2900639955 1.01
clickbench-sorted_q24/datafusion:parquet 33841670 30869034 1.10
clickbench-sorted_q26/datafusion:parquet 33725977 33885592 1.00
clickbench-sorted_q36/datafusion:parquet 184855069 172242372 1.07
clickbench-sorted_q37/datafusion:parquet 102685372 109334157 0.94
clickbench-sorted_q38/datafusion:parquet 164624551 155031591 1.06
clickbench-sorted_q39/datafusion:parquet 308332486 288311491 1.07
clickbench-sorted_q40/datafusion:parquet 67306425 70417068 0.96
clickbench-sorted_q41/datafusion:parquet 60329964 60602479 1.00
clickbench-sorted_q42/datafusion:parquet 36074307 33545145 1.08
duckdb / vortex-file-compressed / ns (0.984x ➖, 1↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:vortex-file-compressed 214838598 231391385 0.93
clickbench-sorted_q24/duckdb:vortex-file-compressed 37795145 37786244 1.00
clickbench-sorted_q26/duckdb:vortex-file-compressed 65234268 64737262 1.01
clickbench-sorted_q36/duckdb:vortex-file-compressed 71219434 71875995 0.99
clickbench-sorted_q37/duckdb:vortex-file-compressed 54213680 53738499 1.01
clickbench-sorted_q38/duckdb:vortex-file-compressed 66462686 67310951 0.99
clickbench-sorted_q39/duckdb:vortex-file-compressed 115599689 115058535 1.00
clickbench-sorted_q40/duckdb:vortex-file-compressed 40852545 38822288 1.05
clickbench-sorted_q41/duckdb:vortex-file-compressed 🚀 36029037 41636339 0.87
clickbench-sorted_q42/duckdb:vortex-file-compressed 31041801 30910327 1.00
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:parquet 245168897 225232208 1.09
clickbench-sorted_q24/duckdb:parquet 33192175 30756745 1.08
clickbench-sorted_q26/duckdb:parquet 22717757 23674832 0.96
clickbench-sorted_q36/duckdb:parquet 69916428 71164636 0.98
clickbench-sorted_q37/duckdb:parquet 57908635 57361555 1.01
clickbench-sorted_q38/duckdb:parquet 61116512 63323302 0.97
clickbench-sorted_q39/duckdb:parquet 107315808 109584071 0.98
clickbench-sorted_q40/duckdb:parquet 29606989 29379803 1.01
clickbench-sorted_q41/duckdb:parquet 28603234 28779742 0.99
clickbench-sorted_q42/duckdb:parquet 19815660 21085877 0.94

File Size Changes (201 files changed, -42.8% overall, 42↑ 159↓)
File Scale Format Base HEAD Change %
hits_027.vortex 1.0 vortex-file-compressed 190.07 MB 193.87 MB +3.80 MB +2.0%
hits_001.vortex 1.0 vortex-file-compressed 191.23 MB 193.41 MB +2.19 MB +1.1%
hits_053.vortex 1.0 vortex-file-compressed 189.97 MB 191.91 MB +1.94 MB +1.0%
hits_008.vortex 1.0 vortex-file-compressed 140.04 MB 141.01 MB +994.04 KB +0.7%
hits_055.vortex 1.0 vortex-file-compressed 198.79 MB 199.80 MB +1.01 MB +0.5%
hits_007.vortex 1.0 vortex-file-compressed 199.20 MB 200.17 MB +991.77 KB +0.5%
hits_014.vortex 1.0 vortex-file-compressed 172.14 MB 172.66 MB +532.30 KB +0.3%
hits_078.vortex 1.0 vortex-file-compressed 130.98 MB 131.36 MB +391.24 KB +0.3%
hits_088.vortex 1.0 vortex-file-compressed 172.03 MB 172.53 MB +503.45 KB +0.3%
hits_098.vortex 1.0 vortex-file-compressed 137.41 MB 137.76 MB +358.74 KB +0.3%
hits_072.vortex 1.0 vortex-file-compressed 102.41 MB 102.64 MB +235.66 KB +0.2%
hits_051.vortex 1.0 vortex-file-compressed 172.28 MB 172.62 MB +341.82 KB +0.2%
hits_092.vortex 1.0 vortex-file-compressed 199.47 MB 199.74 MB +266.76 KB +0.1%
hits_089.vortex 1.0 vortex-file-compressed 131.39 MB 131.55 MB +163.34 KB +0.1%
hits_087.vortex 1.0 vortex-file-compressed 160.95 MB 161.13 MB +192.63 KB +0.1%
hits_049.vortex 1.0 vortex-file-compressed 191.46 MB 191.68 MB +224.35 KB +0.1%
hits_010.vortex 1.0 vortex-file-compressed 169.02 MB 169.17 MB +151.41 KB +0.1%
hits_036.vortex 1.0 vortex-file-compressed 171.30 MB 171.44 MB +148.38 KB +0.1%
hits_028.vortex 1.0 vortex-file-compressed 151.72 MB 151.84 MB +122.77 KB +0.1%
hits_018.vortex 1.0 vortex-file-compressed 199.62 MB 199.77 MB +149.20 KB +0.1%
hits_017.vortex 1.0 vortex-file-compressed 146.79 MB 146.89 MB +107.55 KB +0.1%
hits_037.vortex 1.0 vortex-file-compressed 177.16 MB 177.26 MB +105.34 KB +0.1%
hits_065.vortex 1.0 vortex-file-compressed 161.27 MB 161.36 MB +94.27 KB +0.1%
hits_071.vortex 1.0 vortex-file-compressed 140.04 MB 140.12 MB +75.61 KB +0.1%
hits_069.vortex 1.0 vortex-file-compressed 142.28 MB 142.33 MB +58.84 KB +0.0%
hits_085.vortex 1.0 vortex-file-compressed 199.72 MB 199.78 MB +67.70 KB +0.0%
hits_003.vortex 1.0 vortex-file-compressed 136.52 MB 136.56 MB +44.31 KB +0.0%
hits_030.vortex 1.0 vortex-file-compressed 131.92 MB 131.96 MB +36.77 KB +0.0%
hits_026.vortex 1.0 vortex-file-compressed 131.28 MB 131.31 MB +33.12 KB +0.0%
hits_046.vortex 1.0 vortex-file-compressed 101.14 MB 101.16 MB +21.38 KB +0.0%
hits_009.vortex 1.0 vortex-file-compressed 101.42 MB 101.44 MB +20.68 KB +0.0%
hits_075.vortex 1.0 vortex-file-compressed 189.47 MB 189.50 MB +36.17 KB +0.0%
hits_093.vortex 1.0 vortex-file-compressed 131.74 MB 131.76 MB +24.41 KB +0.0%
hits_054.vortex 1.0 vortex-file-compressed 146.99 MB 147.02 MB +22.60 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.03 MB 147.05 MB +21.80 KB +0.0%
hits_002.vortex 1.0 vortex-file-compressed 161.11 MB 161.13 MB +23.46 KB +0.0%
hits_029.vortex 1.0 vortex-file-compressed 199.78 MB 199.80 MB +24.98 KB +0.0%
hits_011.vortex 1.0 vortex-file-compressed 199.37 MB 199.40 MB +22.16 KB +0.0%
hits_013.vortex 1.0 vortex-file-compressed 161.25 MB 161.26 MB +16.34 KB +0.0%
hits_094.vortex 1.0 vortex-file-compressed 159.05 MB 159.06 MB +14.34 KB +0.0%
hits_060.vortex 1.0 vortex-file-compressed 193.29 MB 193.30 MB +12.44 KB +0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.38 MB 126.38 MB +7.02 KB +0.0%
hits_057.vortex 1.0 vortex-file-compressed 160.47 MB 160.47 MB 248 B -0.0%
hits_081.vortex 1.0 vortex-file-compressed 200.22 MB 200.21 MB 3.35 KB -0.0%
hits_058.vortex 1.0 vortex-file-compressed 155.22 MB 155.22 MB 3.24 KB -0.0%
hits_070.vortex 1.0 vortex-file-compressed 199.98 MB 199.98 MB 4.19 KB -0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.90 MB 126.90 MB 7.05 KB -0.0%
hits_025.vortex 1.0 vortex-file-compressed 172.04 MB 172.03 MB 13.39 KB -0.0%
hits_079.vortex 1.0 vortex-file-compressed 181.24 MB 181.22 MB 17.37 KB -0.0%
hits_005.vortex 1.0 vortex-file-compressed 167.53 MB 167.51 MB 19.16 KB -0.0%
hits_076.vortex 1.0 vortex-file-compressed 161.00 MB 160.98 MB 19.30 KB -0.0%
hits_043.vortex 1.0 vortex-file-compressed 126.57 MB 126.53 MB 35.98 KB -0.0%
hits_041.vortex 1.0 vortex-file-compressed 131.38 MB 131.34 MB 44.78 KB -0.0%
hits_066.vortex 1.0 vortex-file-compressed 163.26 MB 163.20 MB 62.30 KB -0.0%
hits_015.vortex 1.0 vortex-file-compressed 131.30 MB 131.25 MB 52.54 KB -0.0%
hits_047.vortex 1.0 vortex-file-compressed 154.67 MB 154.61 MB 63.59 KB -0.0%
hits_048.vortex 1.0 vortex-file-compressed 199.51 MB 199.43 MB 85.35 KB -0.0%
hits_034.vortex 1.0 vortex-file-compressed 182.11 MB 182.03 MB 79.66 KB -0.0%
hits_020.vortex 1.0 vortex-file-compressed 160.17 MB 160.10 MB 72.23 KB -0.0%
hits_073.vortex 1.0 vortex-file-compressed 172.67 MB 172.59 MB 79.56 KB -0.0%
hits_035.vortex 1.0 vortex-file-compressed 102.97 MB 102.91 MB 52.00 KB -0.0%
hits_021.vortex 1.0 vortex-file-compressed 154.43 MB 154.35 MB 86.44 KB -0.1%
hits_004.vortex 1.0 vortex-file-compressed 131.61 MB 131.54 MB 76.13 KB -0.1%
hits_019.vortex 1.0 vortex-file-compressed 140.99 MB 140.91 MB 82.52 KB -0.1%
hits_042.vortex 1.0 vortex-file-compressed 201.65 MB 201.53 MB 118.43 KB -0.1%
hits_095.vortex 1.0 vortex-file-compressed 154.47 MB 154.38 MB 93.93 KB -0.1%
hits_096.vortex 1.0 vortex-file-compressed 199.53 MB 199.41 MB 131.44 KB -0.1%
hits_083.vortex 1.0 vortex-file-compressed 157.24 MB 157.13 MB 112.30 KB -0.1%
hits_077.vortex 1.0 vortex-file-compressed 172.56 MB 172.43 MB 134.62 KB -0.1%
hits_039.vortex 1.0 vortex-file-compressed 161.33 MB 161.20 MB 133.25 KB -0.1%
hits_064.vortex 1.0 vortex-file-compressed 191.12 MB 190.96 MB 163.57 KB -0.1%
hits_056.vortex 1.0 vortex-file-compressed 135.72 MB 135.60 MB 117.41 KB -0.1%
hits_000.vortex 1.0 vortex-file-compressed 131.65 MB 131.50 MB 151.16 KB -0.1%
hits_068.vortex 1.0 vortex-file-compressed 160.71 MB 160.53 MB 190.27 KB -0.1%
hits_063.vortex 1.0 vortex-file-compressed 131.91 MB 131.75 MB 159.03 KB -0.1%
hits_067.vortex 1.0 vortex-file-compressed 131.87 MB 131.70 MB 175.88 KB -0.1%
hits_031.vortex 1.0 vortex-file-compressed 160.16 MB 159.94 MB 230.67 KB -0.1%
hits_032.vortex 1.0 vortex-file-compressed 155.01 MB 154.75 MB 273.25 KB -0.2%
hits_016.vortex 1.0 vortex-file-compressed 180.52 MB 180.19 MB 340.88 KB -0.2%
hits_062.vortex 1.0 vortex-file-compressed 171.08 MB 170.73 MB 364.64 KB -0.2%
hits_061.vortex 1.0 vortex-file-compressed 161.43 MB 161.05 MB 391.03 KB -0.2%
hits_052.vortex 1.0 vortex-file-compressed 131.06 MB 130.75 MB 319.55 KB -0.2%
hits_097.vortex 1.0 vortex-file-compressed 195.17 MB 194.70 MB 478.67 KB -0.2%
hits_099.vortex 1.0 vortex-file-compressed 171.82 MB 171.33 MB 496.23 KB -0.3%
hits_084.vortex 1.0 vortex-file-compressed 154.99 MB 154.51 MB 491.79 KB -0.3%
hits_040.vortex 1.0 vortex-file-compressed 143.59 MB 143.13 MB 471.96 KB -0.3%
hits_044.vortex 1.0 vortex-file-compressed 200.79 MB 199.94 MB 870.88 KB -0.4%
hits_024.vortex 1.0 vortex-file-compressed 161.11 MB 160.42 MB 705.83 KB -0.4%
hits_082.vortex 1.0 vortex-file-compressed 140.56 MB 139.92 MB 654.07 KB -0.5%
hits_045.vortex 1.0 vortex-file-compressed 140.74 MB 140.08 MB 679.20 KB -0.5%
hits_059.vortex 1.0 vortex-file-compressed 199.03 MB 198.07 MB 982.20 KB -0.5%
hits_074.vortex 1.0 vortex-file-compressed 199.13 MB 198.09 MB 1.04 MB -0.5%
hits_022.vortex 1.0 vortex-file-compressed 199.14 MB 197.93 MB 1.21 MB -0.6%
hits_023.vortex 1.0 vortex-file-compressed 196.72 MB 195.47 MB 1.25 MB -0.6%
hits_033.vortex 1.0 vortex-file-compressed 200.85 MB 198.62 MB 2.23 MB -1.1%
hits_050.vortex 1.0 vortex-file-compressed 161.45 MB 159.53 MB 1.91 MB -1.2%
hits_086.vortex 1.0 vortex-file-compressed 194.54 MB 192.19 MB 2.35 MB -1.2%
hits_090.vortex 1.0 vortex-file-compressed 195.06 MB 192.62 MB 2.43 MB -1.2%
hits_038.vortex 1.0 vortex-file-compressed 192.45 MB 189.95 MB 2.50 MB -1.3%
hits_012.vortex 1.0 vortex-file-compressed 194.86 MB 191.09 MB 3.78 MB -1.9%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_000.vortex 1.0 vortex-compact 99.92 MB 0 B 99.92 MB -100.0%
hits_001.vortex 1.0 vortex-compact 138.98 MB 0 B 138.98 MB -100.0%
hits_002.vortex 1.0 vortex-compact 124.20 MB 0 B 124.20 MB -100.0%
hits_003.vortex 1.0 vortex-compact 104.53 MB 0 B 104.53 MB -100.0%
hits_004.vortex 1.0 vortex-compact 98.55 MB 0 B 98.55 MB -100.0%
hits_005.vortex 1.0 vortex-compact 115.86 MB 0 B 115.86 MB -100.0%
hits_006.vortex 1.0 vortex-compact 96.00 MB 0 B 96.00 MB -100.0%
hits_007.vortex 1.0 vortex-compact 153.52 MB 0 B 153.52 MB -100.0%
hits_008.vortex 1.0 vortex-compact 106.14 MB 0 B 106.14 MB -100.0%
hits_009.vortex 1.0 vortex-compact 75.24 MB 0 B 75.24 MB -100.0%
hits_010.vortex 1.0 vortex-compact 123.35 MB 0 B 123.35 MB -100.0%
hits_011.vortex 1.0 vortex-compact 152.63 MB 0 B 152.63 MB -100.0%
hits_012.vortex 1.0 vortex-compact 140.09 MB 0 B 140.09 MB -100.0%
hits_013.vortex 1.0 vortex-compact 125.34 MB 0 B 125.34 MB -100.0%
hits_014.vortex 1.0 vortex-compact 133.88 MB 0 B 133.88 MB -100.0%
hits_015.vortex 1.0 vortex-compact 98.22 MB 0 B 98.22 MB -100.0%
hits_016.vortex 1.0 vortex-compact 127.64 MB 0 B 127.64 MB -100.0%
hits_017.vortex 1.0 vortex-compact 111.92 MB 0 B 111.92 MB -100.0%
hits_018.vortex 1.0 vortex-compact 152.92 MB 0 B 152.92 MB -100.0%
hits_019.vortex 1.0 vortex-compact 106.58 MB 0 B 106.58 MB -100.0%
hits_020.vortex 1.0 vortex-compact 111.72 MB 0 B 111.72 MB -100.0%
hits_021.vortex 1.0 vortex-compact 110.63 MB 0 B 110.63 MB -100.0%
hits_022.vortex 1.0 vortex-compact 153.10 MB 0 B 153.10 MB -100.0%
hits_023.vortex 1.0 vortex-compact 142.64 MB 0 B 142.64 MB -100.0%
hits_024.vortex 1.0 vortex-compact 125.06 MB 0 B 125.06 MB -100.0%
hits_025.vortex 1.0 vortex-compact 133.68 MB 0 B 133.68 MB -100.0%
hits_026.vortex 1.0 vortex-compact 97.94 MB 0 B 97.94 MB -100.0%
hits_027.vortex 1.0 vortex-compact 138.12 MB 0 B 138.12 MB -100.0%
hits_028.vortex 1.0 vortex-compact 115.69 MB 0 B 115.69 MB -100.0%
hits_029.vortex 1.0 vortex-compact 153.49 MB 0 B 153.49 MB -100.0%
hits_030.vortex 1.0 vortex-compact 98.25 MB 0 B 98.25 MB -100.0%
hits_031.vortex 1.0 vortex-compact 111.16 MB 0 B 111.16 MB -100.0%
hits_032.vortex 1.0 vortex-compact 110.63 MB 0 B 110.63 MB -100.0%
hits_033.vortex 1.0 vortex-compact 153.52 MB 0 B 153.52 MB -100.0%
hits_034.vortex 1.0 vortex-compact 133.94 MB 0 B 133.94 MB -100.0%
hits_035.vortex 1.0 vortex-compact 75.95 MB 0 B 75.95 MB -100.0%
hits_036.vortex 1.0 vortex-compact 133.39 MB 0 B 133.39 MB -100.0%
hits_037.vortex 1.0 vortex-compact 132.51 MB 0 B 132.51 MB -100.0%
hits_038.vortex 1.0 vortex-compact 139.55 MB 0 B 139.55 MB -100.0%
hits_039.vortex 1.0 vortex-compact 125.95 MB 0 B 125.95 MB -100.0%
hits_040.vortex 1.0 vortex-compact 109.96 MB 0 B 109.96 MB -100.0%
hits_041.vortex 1.0 vortex-compact 98.80 MB 0 B 98.80 MB -100.0%
hits_042.vortex 1.0 vortex-compact 136.25 MB 0 B 136.25 MB -100.0%
hits_043.vortex 1.0 vortex-compact 94.29 MB 0 B 94.29 MB -100.0%
hits_044.vortex 1.0 vortex-compact 153.72 MB 0 B 153.72 MB -100.0%
hits_045.vortex 1.0 vortex-compact 106.12 MB 0 B 106.12 MB -100.0%
hits_046.vortex 1.0 vortex-compact 74.99 MB 0 B 74.99 MB -100.0%
hits_047.vortex 1.0 vortex-compact 110.87 MB 0 B 110.87 MB -100.0%
hits_048.vortex 1.0 vortex-compact 153.28 MB 0 B 153.28 MB -100.0%
hits_049.vortex 1.0 vortex-compact 140.66 MB 0 B 140.66 MB -100.0%
hits_050.vortex 1.0 vortex-compact 125.60 MB 0 B 125.60 MB -100.0%
hits_051.vortex 1.0 vortex-compact 133.79 MB 0 B 133.79 MB -100.0%
hits_052.vortex 1.0 vortex-compact 98.05 MB 0 B 98.05 MB -100.0%
hits_053.vortex 1.0 vortex-compact 138.41 MB 0 B 138.41 MB -100.0%
hits_054.vortex 1.0 vortex-compact 112.31 MB 0 B 112.31 MB -100.0%
hits_055.vortex 1.0 vortex-compact 153.36 MB 0 B 153.36 MB -100.0%
hits_056.vortex 1.0 vortex-compact 101.38 MB 0 B 101.38 MB -100.0%
hits_057.vortex 1.0 vortex-compact 111.83 MB 0 B 111.83 MB -100.0%
hits_058.vortex 1.0 vortex-compact 111.07 MB 0 B 111.07 MB -100.0%
hits_059.vortex 1.0 vortex-compact 152.98 MB 0 B 152.98 MB -100.0%
hits_060.vortex 1.0 vortex-compact 140.09 MB 0 B 140.09 MB -100.0%
hits_061.vortex 1.0 vortex-compact 123.93 MB 0 B 123.93 MB -100.0%
hits_062.vortex 1.0 vortex-compact 132.72 MB 0 B 132.72 MB -100.0%
hits_063.vortex 1.0 vortex-compact 98.48 MB 0 B 98.48 MB -100.0%
hits_064.vortex 1.0 vortex-compact 140.15 MB 0 B 140.15 MB -100.0%
hits_065.vortex 1.0 vortex-compact 125.78 MB 0 B 125.78 MB -100.0%
hits_066.vortex 1.0 vortex-compact 117.75 MB 0 B 117.75 MB -100.0%
hits_067.vortex 1.0 vortex-compact 99.43 MB 0 B 99.43 MB -100.0%
hits_068.vortex 1.0 vortex-compact 112.47 MB 0 B 112.47 MB -100.0%
hits_069.vortex 1.0 vortex-compact 100.00 MB 0 B 100.00 MB -100.0%
hits_070.vortex 1.0 vortex-compact 153.51 MB 0 B 153.51 MB -100.0%
hits_071.vortex 1.0 vortex-compact 106.16 MB 0 B 106.16 MB -100.0%
hits_072.vortex 1.0 vortex-compact 75.64 MB 0 B 75.64 MB -100.0%
hits_073.vortex 1.0 vortex-compact 134.18 MB 0 B 134.18 MB -100.0%
hits_074.vortex 1.0 vortex-compact 153.07 MB 0 B 153.07 MB -100.0%
hits_075.vortex 1.0 vortex-compact 139.14 MB 0 B 139.14 MB -100.0%
hits_076.vortex 1.0 vortex-compact 124.31 MB 0 B 124.31 MB -100.0%
hits_077.vortex 1.0 vortex-compact 134.65 MB 0 B 134.65 MB -100.0%
hits_078.vortex 1.0 vortex-compact 98.00 MB 0 B 98.00 MB -100.0%
hits_079.vortex 1.0 vortex-compact 128.20 MB 0 B 128.20 MB -100.0%
hits_080.vortex 1.0 vortex-compact 94.48 MB 0 B 94.48 MB -100.0%
hits_081.vortex 1.0 vortex-compact 153.74 MB 0 B 153.74 MB -100.0%
hits_082.vortex 1.0 vortex-compact 106.22 MB 0 B 106.22 MB -100.0%
hits_083.vortex 1.0 vortex-compact 110.09 MB 0 B 110.09 MB -100.0%
hits_084.vortex 1.0 vortex-compact 110.70 MB 0 B 110.70 MB -100.0%
hits_085.vortex 1.0 vortex-compact 153.11 MB 0 B 153.11 MB -100.0%
hits_086.vortex 1.0 vortex-compact 141.38 MB 0 B 141.38 MB -100.0%
hits_087.vortex 1.0 vortex-compact 125.77 MB 0 B 125.77 MB -100.0%
hits_088.vortex 1.0 vortex-compact 134.09 MB 0 B 134.09 MB -100.0%
hits_089.vortex 1.0 vortex-compact 98.25 MB 0 B 98.25 MB -100.0%
hits_090.vortex 1.0 vortex-compact 141.24 MB 0 B 141.24 MB -100.0%
hits_091.vortex 1.0 vortex-compact 111.71 MB 0 B 111.71 MB -100.0%
hits_092.vortex 1.0 vortex-compact 153.24 MB 0 B 153.24 MB -100.0%
hits_093.vortex 1.0 vortex-compact 98.17 MB 0 B 98.17 MB -100.0%
hits_094.vortex 1.0 vortex-compact 110.70 MB 0 B 110.70 MB -100.0%
hits_095.vortex 1.0 vortex-compact 110.66 MB 0 B 110.66 MB -100.0%
hits_096.vortex 1.0 vortex-compact 153.05 MB 0 B 153.05 MB -100.0%
hits_097.vortex 1.0 vortex-compact 140.26 MB 0 B 140.26 MB -100.0%
hits_098.vortex 1.0 vortex-compact 102.43 MB 0 B 102.43 MB -100.0%
hits_099.vortex 1.0 vortex-compact 133.03 MB 0 B 133.03 MB -100.0%

Totals:

  • vortex-compact: 11.93 GB → 0 B (-100.0%)
  • vortex-file-compressed: 15.98 GB → 15.97 GB (-0.1%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.5%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): 0.998x ➖
Parquet (geomean): 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 352505578 332973177 1.06
tpch_q02/datafusion:vortex-file-compressed 103752189 99795469 1.04
tpch_q03/datafusion:vortex-file-compressed 159211567 163650169 0.97
tpch_q04/datafusion:vortex-file-compressed 71316258 71418410 1.00
tpch_q05/datafusion:vortex-file-compressed 264878059 279415164 0.95
tpch_q06/datafusion:vortex-file-compressed 27460277 27771930 0.99
tpch_q07/datafusion:vortex-file-compressed 370466575 366322181 1.01
tpch_q08/datafusion:vortex-file-compressed 282562780 293947695 0.96
tpch_q09/datafusion:vortex-file-compressed 477150491 498716555 0.96
tpch_q10/datafusion:vortex-file-compressed 182980088 184053198 0.99
tpch_q11/datafusion:vortex-file-compressed 74404022 77776950 0.96
tpch_q12/datafusion:vortex-file-compressed 86172991 85912504 1.00
tpch_q13/datafusion:vortex-file-compressed 119791030 120227034 1.00
tpch_q14/datafusion:vortex-file-compressed 42071815 42174727 1.00
tpch_q15/datafusion:vortex-file-compressed 74319453 76370096 0.97
tpch_q16/datafusion:vortex-file-compressed 72713277 69833334 1.04
tpch_q17/datafusion:vortex-file-compressed 441373706 421119897 1.05
tpch_q18/datafusion:vortex-file-compressed 646980376 633254161 1.02
tpch_q19/datafusion:vortex-file-compressed 67582833 65534831 1.03
tpch_q20/datafusion:vortex-file-compressed 135974836 139520119 0.97
tpch_q21/datafusion:vortex-file-compressed 472885117 473164145 1.00
tpch_q22/datafusion:vortex-file-compressed 41402003 41676746 0.99
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 322433120 323346418 1.00
tpch_q02/datafusion:parquet 224412004 224235789 1.00
tpch_q03/datafusion:parquet 228993682 228364184 1.00
tpch_q04/datafusion:parquet 98523063 98543270 1.00
tpch_q05/datafusion:parquet 362579965 367341834 0.99
tpch_q06/datafusion:parquet 73906488 72275837 1.02
tpch_q07/datafusion:parquet 514170856 511664199 1.00
tpch_q08/datafusion:parquet 409506548 410470284 1.00
tpch_q09/datafusion:parquet 670709221 671161026 1.00
tpch_q10/datafusion:parquet 550904653 546549757 1.01
tpch_q11/datafusion:parquet 154668421 151547103 1.02
tpch_q12/datafusion:parquet 152647350 151243367 1.01
tpch_q13/datafusion:parquet 341038398 354783041 0.96
tpch_q14/datafusion:parquet 119678607 121864025 0.98
tpch_q15/datafusion:parquet 190566799 186724733 1.02
tpch_q16/datafusion:parquet 136230195 137950441 0.99
tpch_q17/datafusion:parquet 515526955 498513511 1.03
tpch_q18/datafusion:parquet 692424619 715184545 0.97
tpch_q19/datafusion:parquet 207351956 200428726 1.03
tpch_q20/datafusion:parquet 299713390 296405592 1.01
tpch_q21/datafusion:parquet 538403341 539218054 1.00
tpch_q22/datafusion:parquet 263259388 260084287 1.01
duckdb / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 86848434 88692230 0.98
tpch_q02/duckdb:vortex-file-compressed 76313270 75071558 1.02
tpch_q03/duckdb:vortex-file-compressed 136367701 135804680 1.00
tpch_q04/duckdb:vortex-file-compressed 164559467 164297104 1.00
tpch_q05/duckdb:vortex-file-compressed 151181939 150756735 1.00
tpch_q06/duckdb:vortex-file-compressed 38394591 39495195 0.97
tpch_q07/duckdb:vortex-file-compressed 140723896 140324192 1.00
tpch_q08/duckdb:vortex-file-compressed 178810172 184156370 0.97
tpch_q09/duckdb:vortex-file-compressed 301243756 309248520 0.97
tpch_q10/duckdb:vortex-file-compressed 215038679 222407747 0.97
tpch_q11/duckdb:vortex-file-compressed 40682133 40584123 1.00
tpch_q12/duckdb:vortex-file-compressed 118820639 116747170 1.02
tpch_q13/duckdb:vortex-file-compressed 167856506 167717984 1.00
tpch_q14/duckdb:vortex-file-compressed 59349115 59115403 1.00
tpch_q15/duckdb:vortex-file-compressed 93248483 90239714 1.03
tpch_q16/duckdb:vortex-file-compressed 85770959 85043087 1.01
tpch_q17/duckdb:vortex-file-compressed 105845043 104437138 1.01
tpch_q18/duckdb:vortex-file-compressed 256229385 264678853 0.97
tpch_q19/duckdb:vortex-file-compressed 80987646 83167056 0.97
tpch_q20/duckdb:vortex-file-compressed 149586366 147602921 1.01
tpch_q21/duckdb:vortex-file-compressed 482290168 490684844 0.98
tpch_q22/duckdb:vortex-file-compressed 80625264 77369541 1.04
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 143058883 142229230 1.01
tpch_q02/duckdb:parquet 101338891 101269618 1.00
tpch_q03/duckdb:parquet 168490111 162685029 1.04
tpch_q04/duckdb:parquet 119325884 122616158 0.97
tpch_q05/duckdb:parquet 183939840 186184075 0.99
tpch_q06/duckdb:parquet 55843718 59028656 0.95
tpch_q07/duckdb:parquet 150282200 148773804 1.01
tpch_q08/duckdb:parquet 215498773 219846484 0.98
tpch_q09/duckdb:parquet 348274662 348152535 1.00
tpch_q10/duckdb:parquet 653586925 657237686 0.99
tpch_q11/duckdb:parquet 41161280 41024672 1.00
tpch_q12/duckdb:parquet 118973152 120792341 0.98
tpch_q13/duckdb:parquet 396712483 395767087 1.00
tpch_q14/duckdb:parquet 151653795 151743747 1.00
tpch_q15/duckdb:parquet 78417631 76261587 1.03
tpch_q16/duckdb:parquet 158656702 154432832 1.03
tpch_q17/duckdb:parquet 121244008 116086684 1.04
tpch_q18/duckdb:parquet 297292941 304057898 0.98
tpch_q19/duckdb:parquet 240572536 238803704 1.01
tpch_q20/duckdb:parquet 196415246 196718386 1.00
tpch_q21/duckdb:parquet 430341918 439438548 0.98
tpch_q22/duckdb:parquet 333771061 335807292 0.99

File Size Changes (9 files changed, -44.0% overall, 0↑ 9↓)
File Scale Format Base HEAD Change %
customer.vortex 10.0 vortex-compact 74.00 MB 0 B 74.00 MB -100.0%
duckdb.db 10.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem.vortex 10.0 vortex-compact 1.28 GB 0 B 1.28 GB -100.0%
nation.vortex 10.0 vortex-compact 8.04 KB 0 B 8.04 KB -100.0%
orders.vortex 10.0 vortex-compact 344.31 MB 0 B 344.31 MB -100.0%
part.vortex 10.0 vortex-compact 35.89 MB 0 B 35.89 MB -100.0%
partsupp.vortex 10.0 vortex-compact 203.66 MB 0 B 203.66 MB -100.0%
region.vortex 10.0 vortex-compact 6.09 KB 0 B 6.09 KB -100.0%
supplier.vortex 10.0 vortex-compact 4.73 MB 0 B 4.73 MB -100.0%

Totals:

  • vortex-compact: 1.92 GB → 0 B (-100.0%)
  • vortex-file-compressed: 2.45 GB → 2.45 GB (0.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-1.9%, low confidence) · DuckDB No clear signal (+1.3%, low confidence)
Vortex (geomean): 0.994x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (0.980x ➖, 2↑ 1↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 2021285 1982052 1.02
clickbench_q01/datafusion:vortex-file-compressed 11871924 11022589 1.08
clickbench_q02/datafusion:vortex-file-compressed 22766997 22564417 1.01
clickbench_q03/datafusion:vortex-file-compressed 25869929 26690237 0.97
clickbench_q04/datafusion:vortex-file-compressed 156584429 157447968 0.99
clickbench_q05/datafusion:vortex-file-compressed 216803142 214812096 1.01
clickbench_q06/datafusion:vortex-file-compressed 1989619 1979542 1.01
clickbench_q07/datafusion:vortex-file-compressed 14611346 14503668 1.01
clickbench_q08/datafusion:vortex-file-compressed 219941627 221125709 0.99
clickbench_q09/datafusion:vortex-file-compressed 342986004 354968248 0.97
clickbench_q10/datafusion:vortex-file-compressed 51592711 52428256 0.98
clickbench_q11/datafusion:vortex-file-compressed 60987504 58521621 1.04
clickbench_q12/datafusion:vortex-file-compressed 195876902 194303762 1.01
clickbench_q13/datafusion:vortex-file-compressed 341855819 338535343 1.01
clickbench_q14/datafusion:vortex-file-compressed 202558459 201045719 1.01
clickbench_q15/datafusion:vortex-file-compressed 192039920 194158349 0.99
clickbench_q16/datafusion:vortex-file-compressed 483094350 463742836 1.04
clickbench_q17/datafusion:vortex-file-compressed 476149554 470935468 1.01
clickbench_q18/datafusion:vortex-file-compressed 935036513 944049185 0.99
clickbench_q19/datafusion:vortex-file-compressed 🚀 17336910 27377901 0.63
clickbench_q20/datafusion:vortex-file-compressed 202618048 205500751 0.99
clickbench_q21/datafusion:vortex-file-compressed 270236825 269424964 1.00
clickbench_q22/datafusion:vortex-file-compressed 332472403 345880396 0.96
clickbench_q23/datafusion:vortex-file-compressed 418811882 417142975 1.00
clickbench_q24/datafusion:vortex-file-compressed 37048252 39262288 0.94
clickbench_q25/datafusion:vortex-file-compressed 47057439 50375131 0.93
clickbench_q26/datafusion:vortex-file-compressed 40500041 40150270 1.01
clickbench_q27/datafusion:vortex-file-compressed 282357532 288400855 0.98
clickbench_q28/datafusion:vortex-file-compressed 1423141817 1460537598 0.97
clickbench_q29/datafusion:vortex-file-compressed 🚀 41682536 56907544 0.73
clickbench_q30/datafusion:vortex-file-compressed 165694870 164261852 1.01
clickbench_q31/datafusion:vortex-file-compressed 198559510 196697233 1.01
clickbench_q32/datafusion:vortex-file-compressed 827110984 817312005 1.01
clickbench_q33/datafusion:vortex-file-compressed 1000866909 1087522831 0.92
clickbench_q34/datafusion:vortex-file-compressed 990210291 1038278082 0.95
clickbench_q35/datafusion:vortex-file-compressed 164197835 164608233 1.00
clickbench_q36/datafusion:vortex-file-compressed 60538824 63548511 0.95
clickbench_q37/datafusion:vortex-file-compressed 29894070 29714634 1.01
clickbench_q38/datafusion:vortex-file-compressed 16105388 15394999 1.05
clickbench_q39/datafusion:vortex-file-compressed 128211490 134472182 0.95
clickbench_q40/datafusion:vortex-file-compressed 🚨 14025823 12599481 1.11
clickbench_q41/datafusion:vortex-file-compressed 11947299 12291281 0.97
clickbench_q42/datafusion:vortex-file-compressed 14534007 13748729 1.06
datafusion / parquet / ns (0.999x ➖, 1↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1954360 1954592 1.00
clickbench_q01/datafusion:parquet 16987455 16788071 1.01
clickbench_q02/datafusion:parquet 32174019 30610745 1.05
clickbench_q03/datafusion:parquet 26991947 26747282 1.01
clickbench_q04/datafusion:parquet 172931045 174046071 0.99
clickbench_q05/datafusion:parquet 238759841 242554657 0.98
clickbench_q06/datafusion:parquet 1973935 1939734 1.02
clickbench_q07/datafusion:parquet 18566713 18461487 1.01
clickbench_q08/datafusion:parquet 235222882 230897246 1.02
clickbench_q09/datafusion:parquet 377014871 368374114 1.02
clickbench_q10/datafusion:parquet 73362510 72653153 1.01
clickbench_q11/datafusion:parquet 92257992 93244106 0.99
clickbench_q12/datafusion:parquet 240129834 238921458 1.01
clickbench_q13/datafusion:parquet 397533942 409077079 0.97
clickbench_q14/datafusion:parquet 256892686 257310109 1.00
clickbench_q15/datafusion:parquet 196486846 200294127 0.98
clickbench_q16/datafusion:parquet 479876139 480310571 1.00
clickbench_q17/datafusion:parquet 472202504 484866231 0.97
clickbench_q18/datafusion:parquet 930074452 925091651 1.01
clickbench_q19/datafusion:parquet 🚀 27632358 31784331 0.87
clickbench_q20/datafusion:parquet 462203948 473766708 0.98
clickbench_q21/datafusion:parquet 488875606 492757404 0.99
clickbench_q22/datafusion:parquet 669386217 659811543 1.01
clickbench_q23/datafusion:parquet 2858146320 2837133394 1.01
clickbench_q24/datafusion:parquet 49485322 54538521 0.91
clickbench_q25/datafusion:parquet 96023346 98999715 0.97
clickbench_q26/datafusion:parquet 49841451 51046306 0.98
clickbench_q27/datafusion:parquet 545677262 547670976 1.00
clickbench_q28/datafusion:parquet 1543684853 1555402309 0.99
clickbench_q29/datafusion:parquet 42001399 41078776 1.02
clickbench_q30/datafusion:parquet 241043175 243496361 0.99
clickbench_q31/datafusion:parquet 275692118 277677728 0.99
clickbench_q32/datafusion:parquet 858448873 874118194 0.98
clickbench_q33/datafusion:parquet 1089015941 1090618204 1.00
clickbench_q34/datafusion:parquet 1095965297 1108608830 0.99
clickbench_q35/datafusion:parquet 169391333 164567398 1.03
clickbench_q36/datafusion:parquet 113094511 120703709 0.94
clickbench_q37/datafusion:parquet 49541012 47946716 1.03
clickbench_q38/datafusion:parquet 74175593 68485072 1.08
clickbench_q39/datafusion:parquet 228637140 232822023 0.98
clickbench_q40/datafusion:parquet 27585115 25520911 1.08
clickbench_q41/datafusion:parquet 26392999 24013704 1.10
clickbench_q42/datafusion:parquet 25891134 25484511 1.02
duckdb / vortex-file-compressed / ns (1.009x ➖, 1↑ 6↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚨 12426554 10588505 1.17
clickbench_q01/duckdb:vortex-file-compressed 🚨 20415809 18525155 1.10
clickbench_q02/duckdb:vortex-file-compressed 19349558 20536972 0.94
clickbench_q03/duckdb:vortex-file-compressed 35802078 35444015 1.01
clickbench_q04/duckdb:vortex-file-compressed 130525710 132072714 0.99
clickbench_q05/duckdb:vortex-file-compressed 170210560 159298968 1.07
clickbench_q06/duckdb:vortex-file-compressed 17648692 17604931 1.00
clickbench_q07/duckdb:vortex-file-compressed 20807005 22424637 0.93
clickbench_q08/duckdb:vortex-file-compressed 170233836 165845640 1.03
clickbench_q09/duckdb:vortex-file-compressed 203775446 204583130 1.00
clickbench_q10/duckdb:vortex-file-compressed 67109339 67662611 0.99
clickbench_q11/duckdb:vortex-file-compressed 71690616 70420032 1.02
clickbench_q12/duckdb:vortex-file-compressed 196822819 187571099 1.05
clickbench_q13/duckdb:vortex-file-compressed 336850864 340589543 0.99
clickbench_q14/duckdb:vortex-file-compressed 216355008 203747380 1.06
clickbench_q15/duckdb:vortex-file-compressed 184725090 183496170 1.01
clickbench_q16/duckdb:vortex-file-compressed 386206566 403455127 0.96
clickbench_q17/duckdb:vortex-file-compressed 382901680 378937434 1.01
clickbench_q18/duckdb:vortex-file-compressed 731079917 736554379 0.99
clickbench_q19/duckdb:vortex-file-compressed 25476774 25703706 0.99
clickbench_q20/duckdb:vortex-file-compressed 240534088 243844852 0.99
clickbench_q21/duckdb:vortex-file-compressed 339497619 354264932 0.96
clickbench_q22/duckdb:vortex-file-compressed 509763093 509001094 1.00
clickbench_q23/duckdb:vortex-file-compressed 🚀 165866640 234355757 0.71
clickbench_q24/duckdb:vortex-file-compressed 55083004 53698545 1.03
clickbench_q25/duckdb:vortex-file-compressed 75216466 75569211 1.00
clickbench_q26/duckdb:vortex-file-compressed 70838355 73419634 0.96
clickbench_q27/duckdb:vortex-file-compressed 182151519 184032936 0.99
clickbench_q28/duckdb:vortex-file-compressed 🚨 1512564388 1296227348 1.17
clickbench_q29/duckdb:vortex-file-compressed 29936985 30083139 1.00
clickbench_q30/duckdb:vortex-file-compressed 150544350 160973907 0.94
clickbench_q31/duckdb:vortex-file-compressed 298881012 300864834 0.99
clickbench_q32/duckdb:vortex-file-compressed 934591123 928666217 1.01
clickbench_q33/duckdb:vortex-file-compressed 1131444655 1088349022 1.04
clickbench_q34/duckdb:vortex-file-compressed 1112473626 1139398133 0.98
clickbench_q35/duckdb:vortex-file-compressed 208481367 209924442 0.99
clickbench_q36/duckdb:vortex-file-compressed 🚨 39644020 35772111 1.11
clickbench_q37/duckdb:vortex-file-compressed 28552404 26732614 1.07
clickbench_q38/duckdb:vortex-file-compressed 🚨 33242072 30006875 1.11
clickbench_q39/duckdb:vortex-file-compressed 53542269 51525960 1.04
clickbench_q40/duckdb:vortex-file-compressed 🚨 30281479 27266290 1.11
clickbench_q41/duckdb:vortex-file-compressed 28155888 27471945 1.02
clickbench_q42/duckdb:vortex-file-compressed 26439115 26795378 0.99
duckdb / parquet / ns (0.995x ➖, 1↑ 1↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 15282119 16216663 0.94
clickbench_q01/duckdb:parquet 🚀 18091622 21141545 0.86
clickbench_q02/duckdb:parquet 24241344 23445966 1.03
clickbench_q03/duckdb:parquet 26503891 27302769 0.97
clickbench_q04/duckdb:parquet 131302738 130883045 1.00
clickbench_q05/duckdb:parquet 183053490 186101439 0.98
clickbench_q06/duckdb:parquet 22737097 23629626 0.96
clickbench_q07/duckdb:parquet 19614442 19607623 1.00
clickbench_q08/duckdb:parquet 164054889 163972886 1.00
clickbench_q09/duckdb:parquet 229581610 231394473 0.99
clickbench_q10/duckdb:parquet 58555866 58020017 1.01
clickbench_q11/duckdb:parquet 66903211 68802438 0.97
clickbench_q12/duckdb:parquet 171862215 175136326 0.98
clickbench_q13/duckdb:parquet 307210939 312803602 0.98
clickbench_q14/duckdb:parquet 186844087 188608453 0.99
clickbench_q15/duckdb:parquet 185368035 186355163 0.99
clickbench_q16/duckdb:parquet 355427504 362112270 0.98
clickbench_q17/duckdb:parquet 363656930 373311109 0.97
clickbench_q18/duckdb:parquet 689303914 691044494 1.00
clickbench_q19/duckdb:parquet 21511594 22243177 0.97
clickbench_q20/duckdb:parquet 264534693 263124656 1.01
clickbench_q21/duckdb:parquet 324023142 323627810 1.00
clickbench_q22/duckdb:parquet 471235942 473190739 1.00
clickbench_q23/duckdb:parquet 244006491 246349526 0.99
clickbench_q24/duckdb:parquet 70764978 68524821 1.03
clickbench_q25/duckdb:parquet 73753389 73841576 1.00
clickbench_q26/duckdb:parquet 🚨 51209182 46535440 1.10
clickbench_q27/duckdb:parquet 271792534 270836989 1.00
clickbench_q28/duckdb:parquet 1715784264 1702996500 1.01
clickbench_q29/duckdb:parquet 27852917 27036517 1.03
clickbench_q30/duckdb:parquet 177636196 176206422 1.01
clickbench_q31/duckdb:parquet 311632172 306784679 1.02
clickbench_q32/duckdb:parquet 909470405 918188398 0.99
clickbench_q33/duckdb:parquet 786871025 778538076 1.01
clickbench_q34/duckdb:parquet 797313569 797973121 1.00
clickbench_q35/duckdb:parquet 207615620 210345158 0.99
clickbench_q36/duckdb:parquet 50160300 50566925 0.99
clickbench_q37/duckdb:parquet 37248555 37559993 0.99
clickbench_q38/duckdb:parquet 37384136 38637162 0.97
clickbench_q39/duckdb:parquet 87687388 87798458 1.00
clickbench_q40/duckdb:parquet 21525190 20881464 1.03
clickbench_q41/duckdb:parquet 20805315 19244603 1.08
clickbench_q42/duckdb:parquet 23072277 23246913 0.99

File Size Changes (101 files changed, -39.2% overall, 0↑ 101↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_0.vortex 1.0 vortex-compact 58.88 MB 0 B 58.88 MB -100.0%
hits_1.vortex 1.0 vortex-compact 90.67 MB 0 B 90.67 MB -100.0%
hits_10.vortex 1.0 vortex-compact 49.48 MB 0 B 49.48 MB -100.0%
hits_11.vortex 1.0 vortex-compact 56.11 MB 0 B 56.11 MB -100.0%
hits_12.vortex 1.0 vortex-compact 69.86 MB 0 B 69.86 MB -100.0%
hits_13.vortex 1.0 vortex-compact 69.24 MB 0 B 69.24 MB -100.0%
hits_14.vortex 1.0 vortex-compact 74.88 MB 0 B 74.88 MB -100.0%
hits_15.vortex 1.0 vortex-compact 48.41 MB 0 B 48.41 MB -100.0%
hits_16.vortex 1.0 vortex-compact 49.56 MB 0 B 49.56 MB -100.0%
hits_17.vortex 1.0 vortex-compact 58.79 MB 0 B 58.79 MB -100.0%
hits_18.vortex 1.0 vortex-compact 64.89 MB 0 B 64.89 MB -100.0%
hits_19.vortex 1.0 vortex-compact 49.73 MB 0 B 49.73 MB -100.0%
hits_2.vortex 1.0 vortex-compact 129.16 MB 0 B 129.16 MB -100.0%
hits_20.vortex 1.0 vortex-compact 38.36 MB 0 B 38.36 MB -100.0%
hits_21.vortex 1.0 vortex-compact 51.99 MB 0 B 51.99 MB -100.0%
hits_22.vortex 1.0 vortex-compact 46.22 MB 0 B 46.22 MB -100.0%
hits_23.vortex 1.0 vortex-compact 46.13 MB 0 B 46.13 MB -100.0%
hits_24.vortex 1.0 vortex-compact 45.11 MB 0 B 45.11 MB -100.0%
hits_25.vortex 1.0 vortex-compact 73.88 MB 0 B 73.88 MB -100.0%
hits_26.vortex 1.0 vortex-compact 71.99 MB 0 B 71.99 MB -100.0%
hits_27.vortex 1.0 vortex-compact 69.86 MB 0 B 69.86 MB -100.0%
hits_28.vortex 1.0 vortex-compact 70.92 MB 0 B 70.92 MB -100.0%
hits_29.vortex 1.0 vortex-compact 36.68 MB 0 B 36.68 MB -100.0%
hits_3.vortex 1.0 vortex-compact 95.12 MB 0 B 95.12 MB -100.0%
hits_30.vortex 1.0 vortex-compact 58.58 MB 0 B 58.58 MB -100.0%
hits_31.vortex 1.0 vortex-compact 55.77 MB 0 B 55.77 MB -100.0%
hits_32.vortex 1.0 vortex-compact 44.61 MB 0 B 44.61 MB -100.0%
hits_33.vortex 1.0 vortex-compact 35.92 MB 0 B 35.92 MB -100.0%
hits_34.vortex 1.0 vortex-compact 58.24 MB 0 B 58.24 MB -100.0%
hits_35.vortex 1.0 vortex-compact 75.53 MB 0 B 75.53 MB -100.0%
hits_36.vortex 1.0 vortex-compact 49.21 MB 0 B 49.21 MB -100.0%
hits_37.vortex 1.0 vortex-compact 54.76 MB 0 B 54.76 MB -100.0%
hits_38.vortex 1.0 vortex-compact 63.39 MB 0 B 63.39 MB -100.0%
hits_39.vortex 1.0 vortex-compact 50.10 MB 0 B 50.10 MB -100.0%
hits_4.vortex 1.0 vortex-compact 71.94 MB 0 B 71.94 MB -100.0%
hits_40.vortex 1.0 vortex-compact 77.42 MB 0 B 77.42 MB -100.0%
hits_41.vortex 1.0 vortex-compact 166.05 MB 0 B 166.05 MB -100.0%
hits_42.vortex 1.0 vortex-compact 164.53 MB 0 B 164.53 MB -100.0%
hits_43.vortex 1.0 vortex-compact 169.21 MB 0 B 169.21 MB -100.0%
hits_44.vortex 1.0 vortex-compact 133.26 MB 0 B 133.26 MB -100.0%
hits_45.vortex 1.0 vortex-compact 75.80 MB 0 B 75.80 MB -100.0%
hits_46.vortex 1.0 vortex-compact 42.27 MB 0 B 42.27 MB -100.0%
hits_47.vortex 1.0 vortex-compact 18.22 MB 0 B 18.22 MB -100.0%
hits_48.vortex 1.0 vortex-compact 17.85 MB 0 B 17.85 MB -100.0%
hits_49.vortex 1.0 vortex-compact 51.00 MB 0 B 51.00 MB -100.0%
hits_5.vortex 1.0 vortex-compact 63.33 MB 0 B 63.33 MB -100.0%
hits_50.vortex 1.0 vortex-compact 114.20 MB 0 B 114.20 MB -100.0%
hits_51.vortex 1.0 vortex-compact 168.34 MB 0 B 168.34 MB -100.0%
hits_52.vortex 1.0 vortex-compact 65.08 MB 0 B 65.08 MB -100.0%
hits_53.vortex 1.0 vortex-compact 60.05 MB 0 B 60.05 MB -100.0%
hits_54.vortex 1.0 vortex-compact 117.57 MB 0 B 117.57 MB -100.0%
hits_55.vortex 1.0 vortex-compact 92.56 MB 0 B 92.56 MB -100.0%
hits_56.vortex 1.0 vortex-compact 78.58 MB 0 B 78.58 MB -100.0%
hits_57.vortex 1.0 vortex-compact 83.73 MB 0 B 83.73 MB -100.0%
hits_58.vortex 1.0 vortex-compact 61.24 MB 0 B 61.24 MB -100.0%
hits_59.vortex 1.0 vortex-compact 66.68 MB 0 B 66.68 MB -100.0%
hits_6.vortex 1.0 vortex-compact 63.57 MB 0 B 63.57 MB -100.0%
hits_60.vortex 1.0 vortex-compact 64.92 MB 0 B 64.92 MB -100.0%
hits_61.vortex 1.0 vortex-compact 57.73 MB 0 B 57.73 MB -100.0%
hits_62.vortex 1.0 vortex-compact 75.45 MB 0 B 75.45 MB -100.0%
hits_63.vortex 1.0 vortex-compact 46.44 MB 0 B 46.44 MB -100.0%
hits_64.vortex 1.0 vortex-compact 54.09 MB 0 B 54.09 MB -100.0%
hits_65.vortex 1.0 vortex-compact 129.40 MB 0 B 129.40 MB -100.0%
hits_66.vortex 1.0 vortex-compact 53.52 MB 0 B 53.52 MB -100.0%
hits_67.vortex 1.0 vortex-compact 114.44 MB 0 B 114.44 MB -100.0%
hits_68.vortex 1.0 vortex-compact 76.67 MB 0 B 76.67 MB -100.0%
hits_69.vortex 1.0 vortex-compact 80.98 MB 0 B 80.98 MB -100.0%
hits_7.vortex 1.0 vortex-compact 64.19 MB 0 B 64.19 MB -100.0%
hits_70.vortex 1.0 vortex-compact 61.84 MB 0 B 61.84 MB -100.0%
hits_71.vortex 1.0 vortex-compact 69.96 MB 0 B 69.96 MB -100.0%
hits_72.vortex 1.0 vortex-compact 52.74 MB 0 B 52.74 MB -100.0%
hits_73.vortex 1.0 vortex-compact 71.07 MB 0 B 71.07 MB -100.0%
hits_74.vortex 1.0 vortex-compact 71.87 MB 0 B 71.87 MB -100.0%
hits_75.vortex 1.0 vortex-compact 45.12 MB 0 B 45.12 MB -100.0%
hits_76.vortex 1.0 vortex-compact 77.10 MB 0 B 77.10 MB -100.0%
hits_77.vortex 1.0 vortex-compact 118.50 MB 0 B 118.50 MB -100.0%
hits_78.vortex 1.0 vortex-compact 97.85 MB 0 B 97.85 MB -100.0%
hits_79.vortex 1.0 vortex-compact 86.17 MB 0 B 86.17 MB -100.0%
hits_8.vortex 1.0 vortex-compact 63.39 MB 0 B 63.39 MB -100.0%
hits_80.vortex 1.0 vortex-compact 68.67 MB 0 B 68.67 MB -100.0%
hits_81.vortex 1.0 vortex-compact 65.95 MB 0 B 65.95 MB -100.0%
hits_82.vortex 1.0 vortex-compact 67.43 MB 0 B 67.43 MB -100.0%
hits_83.vortex 1.0 vortex-compact 53.62 MB 0 B 53.62 MB -100.0%
hits_84.vortex 1.0 vortex-compact 74.35 MB 0 B 74.35 MB -100.0%
hits_85.vortex 1.0 vortex-compact 52.86 MB 0 B 52.86 MB -100.0%
hits_86.vortex 1.0 vortex-compact 49.12 MB 0 B 49.12 MB -100.0%
hits_87.vortex 1.0 vortex-compact 118.86 MB 0 B 118.86 MB -100.0%
hits_88.vortex 1.0 vortex-compact 73.59 MB 0 B 73.59 MB -100.0%
hits_89.vortex 1.0 vortex-compact 114.10 MB 0 B 114.10 MB -100.0%
hits_9.vortex 1.0 vortex-compact 66.32 MB 0 B 66.32 MB -100.0%
hits_90.vortex 1.0 vortex-compact 82.09 MB 0 B 82.09 MB -100.0%
hits_91.vortex 1.0 vortex-compact 61.24 MB 0 B 61.24 MB -100.0%
hits_92.vortex 1.0 vortex-compact 94.40 MB 0 B 94.40 MB -100.0%
hits_93.vortex 1.0 vortex-compact 59.92 MB 0 B 59.92 MB -100.0%
hits_94.vortex 1.0 vortex-compact 90.90 MB 0 B 90.90 MB -100.0%
hits_95.vortex 1.0 vortex-compact 58.20 MB 0 B 58.20 MB -100.0%
hits_96.vortex 1.0 vortex-compact 91.74 MB 0 B 91.74 MB -100.0%
hits_97.vortex 1.0 vortex-compact 69.58 MB 0 B 69.58 MB -100.0%
hits_98.vortex 1.0 vortex-compact 73.15 MB 0 B 73.15 MB -100.0%
hits_99.vortex 1.0 vortex-compact 77.65 MB 0 B 77.65 MB -100.0%

Totals:

  • vortex-compact: 7.11 GB → 0 B (-100.0%)
  • vortex-file-compressed: 11.04 GB → 11.04 GB (0.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -6.0%
Engines: DuckDB No clear signal (-6.0%, low confidence)
Vortex (geomean): 0.943x ➖
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

duckdb / vortex-file-compressed / ns (0.943x ➖, 3↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 16047644 15682395 1.02
statpopgen_q01/duckdb:vortex-file-compressed 13098198 13077325 1.00
statpopgen_q02/duckdb:vortex-file-compressed 606817814 562025109 1.08
statpopgen_q03/duckdb:vortex-file-compressed 🚀 1333382907 1690329743 0.79
statpopgen_q04/duckdb:vortex-file-compressed 1330918618 1323481452 1.01
statpopgen_q05/duckdb:vortex-file-compressed 🚀 650434925 758186099 0.86
statpopgen_q06/duckdb:vortex-file-compressed 1837486640 1765919053 1.04
statpopgen_q07/duckdb:vortex-file-compressed 253997542 253411181 1.00
statpopgen_q08/duckdb:vortex-file-compressed 275184773 271406478 1.01
statpopgen_q09/duckdb:vortex-file-compressed 919748559 962407237 0.96
statpopgen_q10/duckdb:vortex-file-compressed 🚀 2937799754 4262082153 0.69
duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 376762311 375057018 1.00
statpopgen_q01/duckdb:parquet 467366261 466153030 1.00
statpopgen_q02/duckdb:parquet 774947090 776878000 1.00
statpopgen_q03/duckdb:parquet 1059123903 1051908203 1.01
statpopgen_q04/duckdb:parquet 1062343550 1054727349 1.01
statpopgen_q05/duckdb:parquet 759795609 771865884 0.98
statpopgen_q06/duckdb:parquet 1027102840 1011071035 1.02
statpopgen_q07/duckdb:parquet 944101687 934798502 1.01
statpopgen_q08/duckdb:parquet 969799212 964236523 1.01
statpopgen_q09/duckdb:parquet 998373186 1005226797 0.99
statpopgen_q10/duckdb:parquet 1653555593 1647363404 1.00

File Size Changes (2 files changed, -32.3% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 100000 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 960.66 MB 0 B 960.66 MB -100.0%

Totals:

  • vortex-compact: 960.92 MB → 0 B (-100.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (0.0%)

@joseph-isaacs joseph-isaacs changed the title Uniform-zone fast path in ZonedReader::pruning_evaluation Skip per-split zone-mask expansion when covering zones are uniform Aug 7, 2026
@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +13.7%
Engines: DataFusion No clear signal (+10.6%, environment too noisy confidence) · DuckDB No clear signal (+17.0%, environment too noisy confidence)
Vortex (geomean): 1.008x ➖
Parquet (geomean): 0.886x ➖
Shifts: Parquet (control) -11.4% · Median polish -2.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.069x ➖, 0↑ 2↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 36468918 37007779 0.99
fineweb_q01/datafusion:vortex-file-compressed 445666076 450775388 0.99
fineweb_q02/datafusion:vortex-file-compressed 360467883 367970598 0.98
fineweb_q03/datafusion:vortex-file-compressed 461776214 460841051 1.00
fineweb_q04/datafusion:vortex-file-compressed 🚨 611682511 411845561 1.49
fineweb_q05/datafusion:vortex-file-compressed 🚨 514998293 363544932 1.42
fineweb_q06/datafusion:vortex-file-compressed 663136296 683462013 0.97
fineweb_q07/datafusion:vortex-file-compressed 591230395 503071820 1.18
fineweb_q08/datafusion:vortex-file-compressed 194228366 244837190 0.79
datafusion / parquet / ns (0.966x ➖, 0↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 708127625 592219179 1.20
fineweb_q01/datafusion:parquet 935880345 930106914 1.01
fineweb_q02/datafusion:parquet 961522860 1099866718 0.87
fineweb_q03/datafusion:parquet 973438039 1031010809 0.94
fineweb_q04/datafusion:parquet 989643989 1016575133 0.97
fineweb_q05/datafusion:parquet 1006455954 1014596657 0.99
fineweb_q06/datafusion:parquet 953263456 1046564966 0.91
fineweb_q07/datafusion:parquet 870983611 970033106 0.90
fineweb_q08/datafusion:parquet 859668742 917360027 0.94
duckdb / vortex-file-compressed / ns (0.951x ➖, 0↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 54249433 48860870 1.11
fineweb_q01/duckdb:vortex-file-compressed 580115065 599261668 0.97
fineweb_q02/duckdb:vortex-file-compressed 518201344 521312578 0.99
fineweb_q03/duckdb:vortex-file-compressed 1459341201 1616725834 0.90
fineweb_q04/duckdb:vortex-file-compressed 1818422004 1834763528 0.99
fineweb_q05/duckdb:vortex-file-compressed 1611143675 1731602199 0.93
fineweb_q06/duckdb:vortex-file-compressed 1741870363 1915671094 0.91
fineweb_q07/duckdb:vortex-file-compressed 1570429868 1826998255 0.86
fineweb_q08/duckdb:vortex-file-compressed 686888394 751292176 0.91
duckdb / parquet / ns (0.813x ➖, 1↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 5215647275 5272639942 0.99
fineweb_q01/duckdb:parquet 🚀 846474462 5344441594 0.16
fineweb_q02/duckdb:parquet 5348645899 5345960822 1.00
fineweb_q03/duckdb:parquet 5335515040 5347013955 1.00
fineweb_q04/duckdb:parquet 5291977757 5309905679 1.00
fineweb_q05/duckdb:parquet 5275369407 5344151999 0.99
fineweb_q06/duckdb:parquet 5377498029 5347895001 1.01
fineweb_q07/duckdb:parquet 5333108134 5326776543 1.00
fineweb_q08/duckdb:parquet 5278919979 5281117655 1.00

@joseph-isaacs
joseph-isaacs force-pushed the claude/layoutreader-v1-scan-perf-0l1nci branch from 0fa9c84 to 5eff4dc Compare August 7, 2026 11:59
@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.1%
Engines: DataFusion No clear signal (-4.4%, environment too noisy confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): 0.946x ➖
Parquet (geomean): 0.966x ➖
Shifts: Parquet (control) -3.4% · Median polish -4.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (0.925x ➖, 1↑ 1↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 262237616 281942868 0.93
tpch_q02/datafusion:vortex-file-compressed 424141018 461434537 0.92
tpch_q03/datafusion:vortex-file-compressed 335541433 380182822 0.88
tpch_q04/datafusion:vortex-file-compressed 165929220 182288763 0.91
tpch_q05/datafusion:vortex-file-compressed 321439957 369600574 0.87
tpch_q06/datafusion:vortex-file-compressed 249524661 261974924 0.95
tpch_q07/datafusion:vortex-file-compressed 355865931 363408416 0.98
tpch_q08/datafusion:vortex-file-compressed 470507458 513100917 0.92
tpch_q09/datafusion:vortex-file-compressed 🚀 345578389 521004504 0.66
tpch_q10/datafusion:vortex-file-compressed 403700106 368289129 1.10
tpch_q11/datafusion:vortex-file-compressed 325069807 399088124 0.81
tpch_q12/datafusion:vortex-file-compressed 390795103 352579202 1.11
tpch_q13/datafusion:vortex-file-compressed 117267728 122456708 0.96
tpch_q14/datafusion:vortex-file-compressed 183726201 202998971 0.91
tpch_q15/datafusion:vortex-file-compressed 292989258 365497170 0.80
tpch_q16/datafusion:vortex-file-compressed 190924647 251958264 0.76
tpch_q17/datafusion:vortex-file-compressed 306835313 342030126 0.90
tpch_q18/datafusion:vortex-file-compressed 241285859 274800789 0.88
tpch_q19/datafusion:vortex-file-compressed 415002337 423684919 0.98
tpch_q20/datafusion:vortex-file-compressed 397429201 421488783 0.94
tpch_q21/datafusion:vortex-file-compressed 515684382 483596879 1.07
tpch_q22/datafusion:vortex-file-compressed 🚨 185840835 142815112 1.30
datafusion / parquet / ns (0.967x ➖, 0↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 204916026 213462312 0.96
tpch_q02/datafusion:parquet 278683248 275624910 1.01
tpch_q03/datafusion:parquet 292927838 289888536 1.01
tpch_q04/datafusion:parquet 151897108 173756725 0.87
tpch_q05/datafusion:parquet 363183963 378922783 0.96
tpch_q06/datafusion:parquet 137853815 145602609 0.95
tpch_q07/datafusion:parquet 368755036 374364802 0.99
tpch_q08/datafusion:parquet 425754768 428178231 0.99
tpch_q09/datafusion:parquet 482395867 453769513 1.06
tpch_q10/datafusion:parquet 417438358 410592898 1.02
tpch_q11/datafusion:parquet 278376996 277319888 1.00
tpch_q12/datafusion:parquet 202889613 224392446 0.90
tpch_q13/datafusion:parquet 454621505 458501750 0.99
tpch_q14/datafusion:parquet 168264675 174260286 0.97
tpch_q15/datafusion:parquet 278966887 278253147 1.00
tpch_q16/datafusion:parquet 122473167 124414146 0.98
tpch_q17/datafusion:parquet 307270334 324695840 0.95
tpch_q18/datafusion:parquet 452369576 459693606 0.98
tpch_q19/datafusion:parquet 203807736 290006226 0.70
tpch_q20/datafusion:parquet 276862491 316923982 0.87
tpch_q21/datafusion:parquet 464163850 460480871 1.01
tpch_q22/datafusion:parquet 204614706 175479448 1.17
duckdb / vortex-file-compressed / ns (0.968x ➖, 0↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 262543996 279904964 0.94
tpch_q02/duckdb:vortex-file-compressed 602487883 689181001 0.87
tpch_q03/duckdb:vortex-file-compressed 440639364 466446901 0.94
tpch_q04/duckdb:vortex-file-compressed 295630965 314837275 0.94
tpch_q05/duckdb:vortex-file-compressed 586444141 560827757 1.05
tpch_q06/duckdb:vortex-file-compressed 285267107 304397236 0.94
tpch_q07/duckdb:vortex-file-compressed 580156244 602622912 0.96
tpch_q08/duckdb:vortex-file-compressed 715806629 766152960 0.93
tpch_q09/duckdb:vortex-file-compressed 573484893 564943422 1.02
tpch_q10/duckdb:vortex-file-compressed 470757483 488522390 0.96
tpch_q11/duckdb:vortex-file-compressed 273492617 255376425 1.07
tpch_q12/duckdb:vortex-file-compressed 497921739 442070607 1.13
tpch_q13/duckdb:vortex-file-compressed 295512338 312547117 0.95
tpch_q14/duckdb:vortex-file-compressed 265853587 267273499 0.99
tpch_q15/duckdb:vortex-file-compressed 194939783 182286672 1.07
tpch_q16/duckdb:vortex-file-compressed 225488552 239727086 0.94
tpch_q17/duckdb:vortex-file-compressed 442513973 468252198 0.95
tpch_q18/duckdb:vortex-file-compressed 348819845 443974216 0.79
tpch_q19/duckdb:vortex-file-compressed 346450556 371052492 0.93
tpch_q20/duckdb:vortex-file-compressed 509447461 501350816 1.02
tpch_q21/duckdb:vortex-file-compressed 735537950 838515051 0.88
tpch_q22/duckdb:vortex-file-compressed 165947811 150691343 1.10
duckdb / parquet / ns (0.965x ➖, 0↑ 0↓)
name PR 0fa9c84 (ns) base c1ae775 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 322910134 339388849 0.95
tpch_q02/duckdb:parquet 683449206 688718980 0.99
tpch_q03/duckdb:parquet 760487954 822763068 0.92
tpch_q04/duckdb:parquet 463289311 493970691 0.94
tpch_q05/duckdb:parquet 926365643 975837094 0.95
tpch_q06/duckdb:parquet 321280928 347728346 0.92
tpch_q07/duckdb:parquet 894058155 897257588 1.00
tpch_q08/duckdb:parquet 1094684744 1165880024 0.94
tpch_q09/duckdb:parquet 1046503256 1073489732 0.97
tpch_q10/duckdb:parquet 1018918041 1091372880 0.93
tpch_q11/duckdb:parquet 455363955 471118356 0.97
tpch_q12/duckdb:parquet 538351055 563933996 0.95
tpch_q13/duckdb:parquet 847954568 882556673 0.96
tpch_q14/duckdb:parquet 496604422 566096709 0.88
tpch_q15/duckdb:parquet 412248068 420698473 0.98
tpch_q16/duckdb:parquet 518205317 547882572 0.95
tpch_q17/duckdb:parquet 502310025 495724399 1.01
tpch_q18/duckdb:parquet 662260879 660481170 1.00
tpch_q19/duckdb:parquet 595044446 574052513 1.04
tpch_q20/duckdb:parquet 837205581 887499148 0.94
tpch_q21/duckdb:parquet 734553471 767904950 0.96
tpch_q22/duckdb:parquet 484484121 440813469 1.10

@joseph-isaacs
joseph-isaacs force-pushed the claude/layoutreader-v1-scan-perf-0l1nci branch from 5eff4dc to ec8e480 Compare August 7, 2026 12:00
@joseph-isaacs joseph-isaacs added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Aug 7, 2026
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Aug 7, 2026
@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: String Encoding 📖


vortex / vortex-file-compressed / ms (0.999x ➖, 0↑ 0↓)
name PR 3062ebb (ms) base ad5de22 (ms) ratio (PR/base)
read/clickbench/URL/shard-0/fsst 47.717455 47.802857 1.00
read/clickbench/URL/shard-0/onpair-12 36.725136 36.515366 1.01
read/tpch/l_comment/fsst 94.162239 94.518705 1.00
read/tpch/l_comment/onpair-12 107.67865 106.01789 1.02
write/clickbench/URL/shard-0/fsst 868.979855 880.714797 0.99
write/clickbench/URL/shard-0/onpair-12 2119.28711 2109.38267 1.00
write/tpch/l_comment/fsst 3180.09884 3223.75163 0.99
write/tpch/l_comment/onpair-12 3974.83322 3988.37957 1.00
vortex / vortex-file-compressed / % (1.000x ➖, 0↑ 0↓)
name PR 3062ebb (%) base ad5de22 (%) ratio (PR/base)
size/clickbench/URL/shard-0/fsst 47.4688937 47.4688937 1.00
size/clickbench/URL/shard-0/onpair-12 29.7509858 29.7509858 1.00
size/tpch/l_comment/fsst 30.5061014 30.5061014 1.00
size/tpch/l_comment/onpair-12 23.2390033 23.2390033 1.00

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Engines: DataFusion No clear signal (+0.9%, low confidence) · DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): 1.003x ➖
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.029x ➖, 0↑ 1↓)
name PR 3062ebb (ns) base 74a2b86 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 9341638 8739919 1.07
fineweb_q01/datafusion:vortex-file-compressed 🚨 30937184 27451165 1.13
fineweb_q02/datafusion:vortex-file-compressed 36902251 34108983 1.08
fineweb_q03/datafusion:vortex-file-compressed 43379505 40740754 1.06
fineweb_q04/datafusion:vortex-file-compressed 208492221 208383736 1.00
fineweb_q05/datafusion:vortex-file-compressed 155468777 154441684 1.01
fineweb_q06/datafusion:vortex-file-compressed 37759052 37388348 1.01
fineweb_q07/datafusion:vortex-file-compressed 41362419 43413329 0.95
fineweb_q08/datafusion:vortex-file-compressed 16223250 16911536 0.96
datafusion / vortex-compact / ns (1.001x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base 74a2b86 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 9135218 8714369 1.05
fineweb_q01/datafusion:vortex-compact 101596193 101350769 1.00
fineweb_q02/datafusion:vortex-compact 99609946 101044547 0.99
fineweb_q03/datafusion:vortex-compact 530744317 536427967 0.99
fineweb_q04/datafusion:vortex-compact 568108400 560067812 1.01
fineweb_q05/datafusion:vortex-compact 511900859 503092325 1.02
fineweb_q06/datafusion:vortex-compact 288944884 288844043 1.00
fineweb_q07/datafusion:vortex-compact 298273407 299518393 1.00
fineweb_q08/datafusion:vortex-compact 14941633 15574139 0.96
datafusion / parquet / ns (1.006x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base 74a2b86 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 9047935 8345116 1.08
fineweb_q01/datafusion:parquet 197886301 199007141 0.99
fineweb_q02/datafusion:parquet 202356346 199133063 1.02
fineweb_q03/datafusion:parquet 190944692 188987703 1.01
fineweb_q04/datafusion:parquet 209817053 209523268 1.00
fineweb_q05/datafusion:parquet 209012113 209323110 1.00
fineweb_q06/datafusion:parquet 198278359 201736139 0.98
fineweb_q07/datafusion:parquet 194157610 200034889 0.97
fineweb_q08/datafusion:parquet 189075815 189388251 1.00
duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 1↓)
name PR 3062ebb (ns) base 74a2b86 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3494213 3722761 0.94
fineweb_q01/duckdb:vortex-file-compressed 46275075 44721882 1.03
fineweb_q02/duckdb:vortex-file-compressed 49052035 51252585 0.96
fineweb_q03/duckdb:vortex-file-compressed 71430328 70810681 1.01
fineweb_q04/duckdb:vortex-file-compressed 295380498 291289015 1.01
fineweb_q05/duckdb:vortex-file-compressed 219449242 233143891 0.94
fineweb_q06/duckdb:vortex-file-compressed 74186740 71987480 1.03
fineweb_q07/duckdb:vortex-file-compressed 77398409 78413538 0.99
fineweb_q08/duckdb:vortex-file-compressed 🚨 35070087 31673556 1.11
duckdb / vortex-compact / ns (0.982x ➖, 1↑ 1↓)
name PR 3062ebb (ns) base 74a2b86 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 6077751 5438468 1.12
fineweb_q01/duckdb:vortex-compact 105911172 114194511 0.93
fineweb_q02/duckdb:vortex-compact 112456869 114394743 0.98
fineweb_q03/duckdb:vortex-compact 347347248 344102017 1.01
fineweb_q04/duckdb:vortex-compact 378270190 390458966 0.97
fineweb_q05/duckdb:vortex-compact 349946497 355306670 0.98
fineweb_q06/duckdb:vortex-compact 225180987 221650674 1.02
fineweb_q07/duckdb:vortex-compact 231194105 226289654 1.02
fineweb_q08/duckdb:vortex-compact 🚀 29425067 35313172 0.83
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base 74a2b86 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 37654874 38625487 0.97
fineweb_q01/duckdb:parquet 75958751 77947820 0.97
fineweb_q02/duckdb:parquet 77814047 78080537 1.00
fineweb_q03/duckdb:parquet 208227965 207415725 1.00
fineweb_q04/duckdb:parquet 238341529 229907174 1.04
fineweb_q05/duckdb:parquet 203180480 201938024 1.01
fineweb_q06/duckdb:parquet 143214542 142121319 1.01
fineweb_q07/duckdb:parquet 143410049 143447320 1.00
fineweb_q08/duckdb:parquet 38209256 38137189 1.00

No file size changes detected.

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.4%
Engines: DataFusion No clear signal (+6.1%, environment too noisy confidence) · DuckDB No clear signal (+2.7%, low confidence)
Vortex (geomean): 1.061x ➖
Parquet (geomean): 1.016x ➖
Shifts: Parquet (control) +1.6% · Median polish +1.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.078x ➖, 1↑ 3↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:vortex-file-compressed 🚨 457678970 231648832 1.98
clickbench-sorted_q24/datafusion:vortex-file-compressed 21269003 22106620 0.96
clickbench-sorted_q26/datafusion:vortex-file-compressed 22770066 22402893 1.02
clickbench-sorted_q36/datafusion:vortex-file-compressed 47524333 51177963 0.93
clickbench-sorted_q37/datafusion:vortex-file-compressed 🚨 42252099 36637958 1.15
clickbench-sorted_q38/datafusion:vortex-file-compressed 🚨 40837393 33488142 1.22
clickbench-sorted_q39/datafusion:vortex-file-compressed 88773856 86906232 1.02
clickbench-sorted_q40/datafusion:vortex-file-compressed 🚀 17878900 22320329 0.80
clickbench-sorted_q41/datafusion:vortex-file-compressed 17579294 17290882 1.02
clickbench-sorted_q42/datafusion:vortex-file-compressed 13431980 13339143 1.01
datafusion / vortex-compact / ns (1.107x ❌, 0↑ 1↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:vortex-compact 🚨 508113190 206809490 2.46
clickbench-sorted_q24/datafusion:vortex-compact 51144389 52711373 0.97
clickbench-sorted_q26/datafusion:vortex-compact 53699985 50120830 1.07
clickbench-sorted_q36/datafusion:vortex-compact 62715161 57202676 1.10
clickbench-sorted_q37/datafusion:vortex-compact 47045374 47422386 0.99
clickbench-sorted_q38/datafusion:vortex-compact 44949492 44744118 1.00
clickbench-sorted_q39/datafusion:vortex-compact 108678203 106172226 1.02
clickbench-sorted_q40/datafusion:vortex-compact 25610917 25993444 0.99
clickbench-sorted_q41/datafusion:vortex-compact 21843650 22549401 0.97
clickbench-sorted_q42/datafusion:vortex-compact 15497340 15221184 1.02
datafusion / parquet / ns (1.029x ➖, 1↑ 1↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:parquet 2895316848 2909810852 1.00
clickbench-sorted_q24/datafusion:parquet 🚀 32407497 38162588 0.85
clickbench-sorted_q26/datafusion:parquet 🚨 47789608 32508226 1.47
clickbench-sorted_q36/datafusion:parquet 176619035 179954134 0.98
clickbench-sorted_q37/datafusion:parquet 109165756 108391097 1.01
clickbench-sorted_q38/datafusion:parquet 155142693 156834714 0.99
clickbench-sorted_q39/datafusion:parquet 316725421 309491342 1.02
clickbench-sorted_q40/datafusion:parquet 71189543 64843443 1.10
clickbench-sorted_q41/datafusion:parquet 60112621 61692752 0.97
clickbench-sorted_q42/datafusion:parquet 34801656 34700571 1.00
duckdb / vortex-file-compressed / ns (1.023x ➖, 0↑ 2↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:vortex-file-compressed 🚨 260216495 230868987 1.13
clickbench-sorted_q24/duckdb:vortex-file-compressed 42033357 43543856 0.97
clickbench-sorted_q26/duckdb:vortex-file-compressed 65569875 60930715 1.08
clickbench-sorted_q36/duckdb:vortex-file-compressed 67609847 70138485 0.96
clickbench-sorted_q37/duckdb:vortex-file-compressed 52978928 51556501 1.03
clickbench-sorted_q38/duckdb:vortex-file-compressed 64751074 65012669 1.00
clickbench-sorted_q39/duckdb:vortex-file-compressed 113589953 116445677 0.98
clickbench-sorted_q40/duckdb:vortex-file-compressed 🚨 38466412 34212664 1.12
clickbench-sorted_q41/duckdb:vortex-file-compressed 36362199 38339425 0.95
clickbench-sorted_q42/duckdb:vortex-file-compressed 34805034 33426355 1.04
duckdb / vortex-compact / ns (1.038x ➖, 0↑ 1↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:vortex-compact 270765404 256860211 1.05
clickbench-sorted_q24/duckdb:vortex-compact 58975217 60349947 0.98
clickbench-sorted_q26/duckdb:vortex-compact 87047455 79610371 1.09
clickbench-sorted_q36/duckdb:vortex-compact 70433867 65482076 1.08
clickbench-sorted_q37/duckdb:vortex-compact 61365496 58339882 1.05
clickbench-sorted_q38/duckdb:vortex-compact 60905609 63819584 0.95
clickbench-sorted_q39/duckdb:vortex-compact 113078790 114940147 0.98
clickbench-sorted_q40/duckdb:vortex-compact 40549477 39351775 1.03
clickbench-sorted_q41/duckdb:vortex-compact 🚨 41404643 37432971 1.11
clickbench-sorted_q42/duckdb:vortex-compact 34273933 32247546 1.06
duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:parquet 217591614 215594898 1.01
clickbench-sorted_q24/duckdb:parquet 30127080 28813724 1.05
clickbench-sorted_q26/duckdb:parquet 22863003 22335431 1.02
clickbench-sorted_q36/duckdb:parquet 68565350 70101349 0.98
clickbench-sorted_q37/duckdb:parquet 57164068 56072973 1.02
clickbench-sorted_q38/duckdb:parquet 59908492 63972357 0.94
clickbench-sorted_q39/duckdb:parquet 108076892 108261706 1.00
clickbench-sorted_q40/duckdb:parquet 30407148 30219132 1.01
clickbench-sorted_q41/duckdb:parquet 29237435 28813109 1.01
clickbench-sorted_q42/duckdb:parquet 20254493 20242678 1.00

File Size Changes (200 files changed, +0.0% overall, 100↑ 100↓)
File Scale Format Base HEAD Change %
hits_001.vortex 1.0 vortex-file-compressed 189.07 MB 193.50 MB +4.43 MB +2.3%
hits_080.vortex 1.0 vortex-compact 95.03 MB 97.05 MB +2.03 MB +2.1%
hits_026.vortex 1.0 vortex-compact 97.48 MB 98.91 MB +1.43 MB +1.5%
hits_023.vortex 1.0 vortex-file-compressed 195.38 MB 198.05 MB +2.66 MB +1.4%
hits_001.vortex 1.0 vortex-compact 139.00 MB 140.51 MB +1.51 MB +1.1%
hits_061.vortex 1.0 vortex-compact 123.93 MB 125.21 MB +1.28 MB +1.0%
hits_064.vortex 1.0 vortex-file-compressed 190.92 MB 192.66 MB +1.74 MB +0.9%
hits_060.vortex 1.0 vortex-compact 140.06 MB 141.26 MB +1.20 MB +0.9%
hits_034.vortex 1.0 vortex-file-compressed 182.12 MB 183.63 MB +1.51 MB +0.8%
hits_086.vortex 1.0 vortex-file-compressed 192.28 MB 193.74 MB +1.45 MB +0.8%
hits_039.vortex 1.0 vortex-compact 124.58 MB 125.43 MB +871.27 KB +0.7%
hits_033.vortex 1.0 vortex-compact 152.44 MB 153.46 MB +1.02 MB +0.7%
hits_065.vortex 1.0 vortex-file-compressed 160.41 MB 161.41 MB +1018.24 KB +0.6%
hits_047.vortex 1.0 vortex-file-compressed 154.62 MB 155.52 MB +920.19 KB +0.6%
hits_050.vortex 1.0 vortex-compact 125.57 MB 126.28 MB +725.13 KB +0.6%
hits_057.vortex 1.0 vortex-file-compressed 160.04 MB 160.88 MB +854.78 KB +0.5%
hits_048.vortex 1.0 vortex-compact 152.63 MB 153.37 MB +754.02 KB +0.5%
hits_040.vortex 1.0 vortex-compact 109.98 MB 110.47 MB +501.84 KB +0.4%
hits_041.vortex 1.0 vortex-compact 97.98 MB 98.38 MB +407.79 KB +0.4%
hits_008.vortex 1.0 vortex-compact 105.75 MB 106.15 MB +406.45 KB +0.4%
hits_087.vortex 1.0 vortex-compact 125.29 MB 125.76 MB +480.52 KB +0.4%
hits_004.vortex 1.0 vortex-compact 98.02 MB 98.38 MB +372.22 KB +0.4%
hits_066.vortex 1.0 vortex-compact 117.02 MB 117.46 MB +442.55 KB +0.4%
hits_063.vortex 1.0 vortex-compact 98.16 MB 98.49 MB +335.36 KB +0.3%
hits_008.vortex 1.0 vortex-file-compressed 140.23 MB 140.69 MB +473.41 KB +0.3%
hits_005.vortex 1.0 vortex-file-compressed 167.43 MB 167.97 MB +550.53 KB +0.3%
hits_031.vortex 1.0 vortex-compact 111.21 MB 111.55 MB +348.71 KB +0.3%
hits_095.vortex 1.0 vortex-compact 110.65 MB 110.96 MB +325.65 KB +0.3%
hits_096.vortex 1.0 vortex-file-compressed 199.48 MB 200.05 MB +581.25 KB +0.3%
hits_040.vortex 1.0 vortex-file-compressed 142.91 MB 143.29 MB +394.05 KB +0.3%
hits_068.vortex 1.0 vortex-file-compressed 160.50 MB 160.93 MB +438.48 KB +0.3%
hits_043.vortex 1.0 vortex-compact 94.35 MB 94.60 MB +257.16 KB +0.3%
hits_099.vortex 1.0 vortex-compact 133.12 MB 133.41 MB +296.65 KB +0.2%
hits_095.vortex 1.0 vortex-file-compressed 154.38 MB 154.71 MB +329.98 KB +0.2%
hits_025.vortex 1.0 vortex-file-compressed 171.95 MB 172.30 MB +361.87 KB +0.2%
hits_022.vortex 1.0 vortex-file-compressed 199.21 MB 199.59 MB +398.95 KB +0.2%
hits_077.vortex 1.0 vortex-compact 134.39 MB 134.64 MB +255.94 KB +0.2%
hits_021.vortex 1.0 vortex-file-compressed 154.20 MB 154.48 MB +286.20 KB +0.2%
hits_035.vortex 1.0 vortex-file-compressed 102.91 MB 103.09 MB +186.71 KB +0.2%
hits_070.vortex 1.0 vortex-file-compressed 199.96 MB 200.31 MB +358.04 KB +0.2%
hits_016.vortex 1.0 vortex-compact 127.35 MB 127.57 MB +225.45 KB +0.2%
hits_009.vortex 1.0 vortex-file-compressed 101.36 MB 101.53 MB +176.48 KB +0.2%
hits_006.vortex 1.0 vortex-compact 96.23 MB 96.40 MB +167.09 KB +0.2%
hits_092.vortex 1.0 vortex-compact 153.27 MB 153.51 MB +241.68 KB +0.2%
hits_083.vortex 1.0 vortex-compact 109.97 MB 110.13 MB +162.85 KB +0.1%
hits_045.vortex 1.0 vortex-compact 106.08 MB 106.20 MB +127.52 KB +0.1%
hits_033.vortex 1.0 vortex-file-compressed 200.13 MB 200.36 MB +226.30 KB +0.1%
hits_043.vortex 1.0 vortex-file-compressed 126.49 MB 126.63 MB +139.25 KB +0.1%
hits_097.vortex 1.0 vortex-file-compressed 192.87 MB 193.06 MB +202.69 KB +0.1%
hits_054.vortex 1.0 vortex-compact 112.10 MB 112.21 MB +117.21 KB +0.1%
hits_059.vortex 1.0 vortex-compact 152.96 MB 153.11 MB +157.05 KB +0.1%
hits_044.vortex 1.0 vortex-file-compressed 200.10 MB 200.30 MB +204.59 KB +0.1%
hits_081.vortex 1.0 vortex-compact 153.66 MB 153.81 MB +151.76 KB +0.1%
hits_063.vortex 1.0 vortex-file-compressed 131.56 MB 131.68 MB +122.63 KB +0.1%
hits_074.vortex 1.0 vortex-compact 153.08 MB 153.21 MB +141.01 KB +0.1%
hits_029.vortex 1.0 vortex-compact 153.37 MB 153.51 MB +139.89 KB +0.1%
hits_027.vortex 1.0 vortex-compact 139.24 MB 139.37 MB +126.93 KB +0.1%
hits_038.vortex 1.0 vortex-compact 139.43 MB 139.55 MB +125.75 KB +0.1%
hits_084.vortex 1.0 vortex-file-compressed 154.56 MB 154.69 MB +136.07 KB +0.1%
hits_015.vortex 1.0 vortex-file-compressed 131.06 MB 131.17 MB +109.41 KB +0.1%
hits_012.vortex 1.0 vortex-file-compressed 190.91 MB 191.06 MB +156.12 KB +0.1%
hits_021.vortex 1.0 vortex-compact 110.62 MB 110.71 MB +86.20 KB +0.1%
hits_091.vortex 1.0 vortex-compact 112.26 MB 112.34 MB +85.06 KB +0.1%
hits_083.vortex 1.0 vortex-file-compressed 157.04 MB 157.16 MB +118.41 KB +0.1%
hits_072.vortex 1.0 vortex-file-compressed 102.37 MB 102.44 MB +75.63 KB +0.1%
hits_093.vortex 1.0 vortex-file-compressed 131.64 MB 131.73 MB +92.52 KB +0.1%
hits_096.vortex 1.0 vortex-compact 153.26 MB 153.36 MB +106.44 KB +0.1%
hits_004.vortex 1.0 vortex-file-compressed 131.49 MB 131.58 MB +83.77 KB +0.1%
hits_041.vortex 1.0 vortex-file-compressed 131.27 MB 131.35 MB +81.12 KB +0.1%
hits_082.vortex 1.0 vortex-file-compressed 139.91 MB 139.99 MB +81.55 KB +0.1%
hits_067.vortex 1.0 vortex-file-compressed 131.77 MB 131.84 MB +75.20 KB +0.1%
hits_013.vortex 1.0 vortex-file-compressed 161.32 MB 161.41 MB +90.62 KB +0.1%
hits_028.vortex 1.0 vortex-compact 115.73 MB 115.80 MB +64.68 KB +0.1%
hits_054.vortex 1.0 vortex-file-compressed 147.03 MB 147.10 MB +78.38 KB +0.1%
hits_091.vortex 1.0 vortex-file-compressed 147.05 MB 147.12 MB +75.18 KB +0.0%
hits_072.vortex 1.0 vortex-compact 75.57 MB 75.60 MB +36.39 KB +0.0%
hits_081.vortex 1.0 vortex-file-compressed 200.17 MB 200.27 MB +96.16 KB +0.0%
hits_070.vortex 1.0 vortex-compact 153.54 MB 153.61 MB +72.09 KB +0.0%
hits_018.vortex 1.0 vortex-compact 152.93 MB 152.99 MB +66.21 KB +0.0%
hits_037.vortex 1.0 vortex-compact 132.15 MB 132.21 MB +56.10 KB +0.0%
hits_067.vortex 1.0 vortex-compact 99.00 MB 99.04 MB +34.37 KB +0.0%
hits_027.vortex 1.0 vortex-file-compressed 189.91 MB 189.97 MB +56.67 KB +0.0%
hits_029.vortex 1.0 vortex-file-compressed 199.90 MB 199.96 MB +59.32 KB +0.0%
hits_089.vortex 1.0 vortex-file-compressed 131.49 MB 131.52 MB +36.76 KB +0.0%
hits_037.vortex 1.0 vortex-file-compressed 177.25 MB 177.30 MB +49.44 KB +0.0%
hits_060.vortex 1.0 vortex-file-compressed 193.09 MB 193.14 MB +53.84 KB +0.0%
hits_051.vortex 1.0 vortex-compact 133.85 MB 133.87 MB +26.39 KB +0.0%
hits_090.vortex 1.0 vortex-compact 140.02 MB 140.04 MB +24.05 KB +0.0%
hits_073.vortex 1.0 vortex-compact 134.18 MB 134.19 MB +18.38 KB +0.0%
hits_047.vortex 1.0 vortex-compact 110.47 MB 110.49 MB +14.55 KB +0.0%
hits_011.vortex 1.0 vortex-compact 152.76 MB 152.77 MB +16.40 KB +0.0%
hits_042.vortex 1.0 vortex-compact 136.30 MB 136.31 MB +14.24 KB +0.0%
hits_003.vortex 1.0 vortex-file-compressed 136.54 MB 136.55 MB +8.70 KB +0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.37 MB 126.37 MB +6.78 KB +0.0%
hits_061.vortex 1.0 vortex-file-compressed 160.84 MB 160.85 MB +7.11 KB +0.0%
hits_035.vortex 1.0 vortex-compact 75.93 MB 75.93 MB +2.19 KB +0.0%
hits_048.vortex 1.0 vortex-file-compressed 199.57 MB 199.58 MB +5.52 KB +0.0%
hits_075.vortex 1.0 vortex-compact 139.11 MB 139.12 MB +1.72 KB +0.0%
hits_024.vortex 1.0 vortex-compact 125.17 MB 125.17 MB +1.09 KB +0.0%
hits_053.vortex 1.0 vortex-compact 138.44 MB 138.44 MB +376 B +0.0%
hits_000.vortex 1.0 vortex-file-compressed 131.83 MB 131.83 MB 704 B -0.0%
hits_009.vortex 1.0 vortex-compact 75.23 MB 75.23 MB 712 B -0.0%
hits_019.vortex 1.0 vortex-compact 106.13 MB 106.13 MB 1.20 KB -0.0%
hits_038.vortex 1.0 vortex-file-compressed 190.17 MB 190.16 MB 4.83 KB -0.0%
hits_071.vortex 1.0 vortex-compact 106.20 MB 106.20 MB 3.17 KB -0.0%
hits_094.vortex 1.0 vortex-compact 110.77 MB 110.77 MB 3.34 KB -0.0%
hits_034.vortex 1.0 vortex-compact 133.33 MB 133.32 MB 4.30 KB -0.0%
hits_085.vortex 1.0 vortex-compact 153.50 MB 153.49 MB 5.53 KB -0.0%
hits_056.vortex 1.0 vortex-file-compressed 135.73 MB 135.73 MB 5.27 KB -0.0%
hits_069.vortex 1.0 vortex-file-compressed 142.67 MB 142.66 MB 6.46 KB -0.0%
hits_011.vortex 1.0 vortex-file-compressed 199.31 MB 199.30 MB 9.10 KB -0.0%
hits_020.vortex 1.0 vortex-compact 111.65 MB 111.64 MB 8.95 KB -0.0%
hits_010.vortex 1.0 vortex-file-compressed 169.06 MB 169.05 MB 15.41 KB -0.0%
hits_036.vortex 1.0 vortex-file-compressed 171.40 MB 171.38 MB 15.71 KB -0.0%
hits_017.vortex 1.0 vortex-compact 111.77 MB 111.76 MB 13.86 KB -0.0%
hits_062.vortex 1.0 vortex-compact 132.60 MB 132.58 MB 17.94 KB -0.0%
hits_016.vortex 1.0 vortex-file-compressed 180.50 MB 180.47 MB 24.57 KB -0.0%
hits_050.vortex 1.0 vortex-file-compressed 161.16 MB 161.14 MB 22.49 KB -0.0%
hits_032.vortex 1.0 vortex-compact 110.64 MB 110.62 MB 15.82 KB -0.0%
hits_022.vortex 1.0 vortex-compact 153.09 MB 153.07 MB 27.71 KB -0.0%
hits_014.vortex 1.0 vortex-file-compressed 172.18 MB 172.15 MB 34.92 KB -0.0%
hits_057.vortex 1.0 vortex-compact 111.82 MB 111.80 MB 23.19 KB -0.0%
hits_002.vortex 1.0 vortex-compact 124.20 MB 124.17 MB 29.10 KB -0.0%
hits_005.vortex 1.0 vortex-compact 115.88 MB 115.85 MB 34.62 KB -0.0%
hits_064.vortex 1.0 vortex-compact 140.04 MB 140.00 MB 47.72 KB -0.0%
hits_051.vortex 1.0 vortex-file-compressed 172.44 MB 172.38 MB 60.77 KB -0.0%
hits_019.vortex 1.0 vortex-file-compressed 141.07 MB 141.01 MB 53.55 KB -0.0%
hits_055.vortex 1.0 vortex-compact 153.38 MB 153.32 MB 58.53 KB -0.0%
hits_028.vortex 1.0 vortex-file-compressed 151.75 MB 151.69 MB 60.62 KB -0.0%
hits_042.vortex 1.0 vortex-file-compressed 201.70 MB 201.61 MB 87.84 KB -0.0%
hits_071.vortex 1.0 vortex-file-compressed 140.80 MB 140.74 MB 61.64 KB -0.0%
hits_074.vortex 1.0 vortex-file-compressed 199.35 MB 199.26 MB 93.89 KB -0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.94 MB 126.88 MB 61.46 KB -0.0%
hits_039.vortex 1.0 vortex-file-compressed 161.14 MB 161.06 MB 79.66 KB -0.0%
hits_082.vortex 1.0 vortex-compact 105.80 MB 105.75 MB 52.38 KB -0.0%
hits_056.vortex 1.0 vortex-compact 101.37 MB 101.32 MB 56.85 KB -0.1%
hits_077.vortex 1.0 vortex-file-compressed 172.60 MB 172.50 MB 104.37 KB -0.1%
hits_086.vortex 1.0 vortex-compact 140.81 MB 140.73 MB 88.33 KB -0.1%
hits_003.vortex 1.0 vortex-compact 104.53 MB 104.47 MB 66.27 KB -0.1%
hits_079.vortex 1.0 vortex-compact 128.24 MB 128.16 MB 81.45 KB -0.1%
hits_036.vortex 1.0 vortex-compact 133.37 MB 133.28 MB 88.72 KB -0.1%
hits_032.vortex 1.0 vortex-file-compressed 154.77 MB 154.67 MB 105.75 KB -0.1%
hits_099.vortex 1.0 vortex-file-compressed 171.29 MB 171.17 MB 118.61 KB -0.1%
hits_052.vortex 1.0 vortex-file-compressed 131.04 MB 130.95 MB 92.34 KB -0.1%
hits_015.vortex 1.0 vortex-compact 98.49 MB 98.42 MB 75.48 KB -0.1%
hits_023.vortex 1.0 vortex-compact 142.76 MB 142.64 MB 117.87 KB -0.1%
hits_046.vortex 1.0 vortex-compact 74.97 MB 74.90 MB 63.66 KB -0.1%
hits_098.vortex 1.0 vortex-compact 104.19 MB 104.10 MB 90.66 KB -0.1%
hits_000.vortex 1.0 vortex-compact 99.12 MB 99.03 MB 86.71 KB -0.1%
hits_062.vortex 1.0 vortex-file-compressed 170.79 MB 170.64 MB 149.83 KB -0.1%
hits_049.vortex 1.0 vortex-file-compressed 191.67 MB 191.50 MB 168.23 KB -0.1%
hits_088.vortex 1.0 vortex-compact 134.12 MB 134.00 MB 119.11 KB -0.1%
hits_087.vortex 1.0 vortex-file-compressed 161.20 MB 161.05 MB 150.23 KB -0.1%
hits_085.vortex 1.0 vortex-file-compressed 199.93 MB 199.72 MB 216.35 KB -0.1%
hits_049.vortex 1.0 vortex-compact 139.45 MB 139.30 MB 153.96 KB -0.1%
hits_014.vortex 1.0 vortex-compact 134.05 MB 133.90 MB 150.15 KB -0.1%
hits_026.vortex 1.0 vortex-file-compressed 131.54 MB 131.40 MB 148.48 KB -0.1%
hits_044.vortex 1.0 vortex-compact 153.73 MB 153.53 MB 209.03 KB -0.1%
hits_078.vortex 1.0 vortex-file-compressed 131.10 MB 130.92 MB 181.12 KB -0.1%
hits_030.vortex 1.0 vortex-file-compressed 131.99 MB 131.82 MB 183.46 KB -0.1%
hits_058.vortex 1.0 vortex-compact 111.07 MB 110.91 MB 156.40 KB -0.1%
hits_031.vortex 1.0 vortex-file-compressed 159.72 MB 159.49 MB 231.37 KB -0.1%
hits_055.vortex 1.0 vortex-file-compressed 199.97 MB 199.67 MB 304.73 KB -0.1%
hits_046.vortex 1.0 vortex-file-compressed 101.43 MB 101.27 MB 160.07 KB -0.2%
hits_075.vortex 1.0 vortex-file-compressed 189.96 MB 189.65 MB 314.73 KB -0.2%
hits_025.vortex 1.0 vortex-compact 133.70 MB 133.48 MB 224.87 KB -0.2%
hits_059.vortex 1.0 vortex-file-compressed 199.51 MB 199.17 MB 350.31 KB -0.2%
hits_092.vortex 1.0 vortex-file-compressed 199.69 MB 199.35 MB 350.95 KB -0.2%
hits_018.vortex 1.0 vortex-file-compressed 199.89 MB 199.52 MB 383.86 KB -0.2%
hits_094.vortex 1.0 vortex-file-compressed 159.09 MB 158.77 MB 328.40 KB -0.2%
hits_010.vortex 1.0 vortex-compact 123.33 MB 123.07 MB 262.14 KB -0.2%
hits_017.vortex 1.0 vortex-file-compressed 147.22 MB 146.91 MB 314.34 KB -0.2%
hits_052.vortex 1.0 vortex-compact 97.98 MB 97.77 MB 222.01 KB -0.2%
hits_065.vortex 1.0 vortex-compact 125.62 MB 125.33 MB 301.00 KB -0.2%
hits_069.vortex 1.0 vortex-compact 99.83 MB 99.59 MB 241.87 KB -0.2%
hits_058.vortex 1.0 vortex-file-compressed 155.58 MB 155.21 MB 378.11 KB -0.2%
hits_007.vortex 1.0 vortex-compact 153.85 MB 153.43 MB 420.69 KB -0.3%
hits_097.vortex 1.0 vortex-compact 141.82 MB 141.41 MB 420.01 KB -0.3%
hits_093.vortex 1.0 vortex-compact 98.93 MB 98.64 MB 293.52 KB -0.3%
hits_079.vortex 1.0 vortex-file-compressed 181.45 MB 180.90 MB 565.62 KB -0.3%
hits_088.vortex 1.0 vortex-file-compressed 172.58 MB 172.03 MB 566.52 KB -0.3%
hits_002.vortex 1.0 vortex-file-compressed 161.70 MB 161.12 MB 588.86 KB -0.4%
hits_073.vortex 1.0 vortex-file-compressed 173.38 MB 172.68 MB 723.77 KB -0.4%
hits_076.vortex 1.0 vortex-file-compressed 161.65 MB 160.98 MB 688.63 KB -0.4%
hits_084.vortex 1.0 vortex-compact 111.16 MB 110.69 MB 478.02 KB -0.4%
hits_045.vortex 1.0 vortex-file-compressed 140.69 MB 140.05 MB 657.74 KB -0.5%
hits_098.vortex 1.0 vortex-file-compressed 138.13 MB 137.50 MB 649.91 KB -0.5%
hits_068.vortex 1.0 vortex-compact 112.48 MB 111.93 MB 561.17 KB -0.5%
hits_076.vortex 1.0 vortex-compact 125.00 MB 124.35 MB 657.93 KB -0.5%
hits_020.vortex 1.0 vortex-file-compressed 160.93 MB 160.07 MB 877.42 KB -0.5%
hits_007.vortex 1.0 vortex-file-compressed 200.14 MB 198.82 MB 1.32 MB -0.7%
hits_078.vortex 1.0 vortex-compact 97.92 MB 97.22 MB 716.79 KB -0.7%
hits_024.vortex 1.0 vortex-file-compressed 160.55 MB 159.23 MB 1.32 MB -0.8%
hits_012.vortex 1.0 vortex-compact 139.97 MB 138.76 MB 1.21 MB -0.9%
hits_089.vortex 1.0 vortex-compact 99.73 MB 98.77 MB 982.21 KB -1.0%
hits_066.vortex 1.0 vortex-file-compressed 164.73 MB 163.06 MB 1.67 MB -1.0%
hits_053.vortex 1.0 vortex-file-compressed 192.12 MB 190.00 MB 2.11 MB -1.1%
hits_090.vortex 1.0 vortex-file-compressed 194.83 MB 192.65 MB 2.18 MB -1.1%
hits_030.vortex 1.0 vortex-compact 99.25 MB 97.94 MB 1.31 MB -1.3%
hits_013.vortex 1.0 vortex-compact 126.70 MB 124.43 MB 2.27 MB -1.8%

Totals:

  • vortex-compact: 11.93 GB → 11.94 GB (+0.0%)
  • vortex-file-compressed: 15.97 GB → 15.97 GB (+0.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: random-access No clear signal (-0.3%, low confidence)
Vortex (geomean): 0.999x ➖
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

random-access / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base 0f0390a (ns) ratio (PR/base)
random-access/feature-vectors/correlated/vortex-tokio-local-disk 504216 471998 1.07
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 2899836 2907036 1.00
random-access/feature-vectors/uniform/vortex-tokio-local-disk 2802826 2839748 0.99
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 5537941 5537141 1.00
random-access/nested-lists/correlated/vortex-tokio-local-disk 284822 289178 0.98
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 373078 371591 1.00
random-access/nested-lists/uniform/vortex-tokio-local-disk 1441127 1428899 1.01
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 1639303 1639292 1.00
random-access/nested-structs/correlated/vortex-tokio-local-disk 333240 329563 1.01
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 470473 483510 0.97
random-access/nested-structs/uniform/vortex-tokio-local-disk 997785 1018724 0.98
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1191179 1188640 1.00
random-access/taxi/correlated/vortex-tokio-local-disk 882617 876850 1.01
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1417817 1439883 0.98
random-access/taxi/uniform/vortex-tokio-local-disk 4085164 4239884 0.96
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4766564 4760589 1.00
random-access/vortex-tokio-local-disk 544582 528001 1.03
random-access/vortex-tokio-local-disk-footer 904927 915270 0.99
random-access / parquet / ns (1.003x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base 0f0390a (ns) ratio (PR/base)
random-access/feature-vectors/correlated/parquet-tokio-local-disk 9015974308 9026531147 1.00
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8830631080 8970167730 0.98
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8957848592 8911661624 1.01
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8943351750 8878801124 1.01
random-access/nested-lists/correlated/parquet-tokio-local-disk 139149848 138928147 1.00
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 138417083 137538154 1.01
random-access/nested-lists/uniform/parquet-tokio-local-disk 138631595 138992548 1.00
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 138360693 140266791 0.99
random-access/nested-structs/correlated/parquet-tokio-local-disk 20416322 20139957 1.01
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 20433538 20182488 1.01
random-access/nested-structs/uniform/parquet-tokio-local-disk 20436018 20708518 0.99
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 20788404 20174848 1.03
random-access/parquet-tokio-local-disk 184306746 183210063 1.01
random-access/parquet-tokio-local-disk-footer 183625298 183426805 1.00
random-access/taxi/correlated/parquet-tokio-local-disk 273963496 274216729 1.00
random-access/taxi/correlated/parquet-tokio-local-disk-footer 275476482 275146293 1.00
random-access/taxi/uniform/parquet-tokio-local-disk 294559772 290224522 1.01
random-access/taxi/uniform/parquet-tokio-local-disk-footer 294716585 295846601 1.00
random-access / lance / ns (0.996x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base 0f0390a (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 369420 363694 1.02
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1054735 1033636 1.02
random-access/feature-vectors/uniform/lance-tokio-local-disk 1129708 1139475 0.99
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1807965 1816588 1.00
random-access/lance-tokio-local-disk 629601 636120 0.99
random-access/lance-tokio-local-disk-footer 1382380 1383725 1.00
random-access/nested-lists/correlated/lance-tokio-local-disk 194285 191075 1.02
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 530809 522839 1.02
random-access/nested-lists/uniform/lance-tokio-local-disk 977482 980330 1.00
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1281399 1314019 0.98
random-access/nested-structs/correlated/lance-tokio-local-disk 321914 330946 0.97
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 466377 471411 0.99
random-access/nested-structs/uniform/lance-tokio-local-disk 2467830 2490194 0.99
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2612367 2615364 1.00
random-access/taxi/correlated/lance-tokio-local-disk 966450 982380 0.98
random-access/taxi/correlated/lance-tokio-local-disk-footer 1935474 1947598 0.99
random-access/taxi/uniform/lance-tokio-local-disk 9916449 9864078 1.01
random-access/taxi/uniform/lance-tokio-local-disk-footer 10399794 10616991 0.98

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -11.4%
Engines: DataFusion No clear signal (-17.5%, environment too noisy confidence) · DuckDB No clear signal (-4.8%, environment too noisy confidence)
Vortex (geomean): 0.904x ➖
Parquet (geomean): 1.021x ➖
Shifts: Parquet (control) +2.1% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-compact / ns (0.851x ➖, 3↑ 0↓)
name PR 3062ebb (ns) base adab5b8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 594236012 573969732 1.04
tpch_q02/datafusion:vortex-compact 700820449 728095353 0.96
tpch_q03/datafusion:vortex-compact 491194823 613850445 0.80
tpch_q04/datafusion:vortex-compact 🚀 257623367 394905795 0.65
tpch_q05/datafusion:vortex-compact 707220672 725423569 0.97
tpch_q06/datafusion:vortex-compact 330586103 464038986 0.71
tpch_q07/datafusion:vortex-compact 715272913 841689358 0.85
tpch_q08/datafusion:vortex-compact 1067911854 1325109236 0.81
tpch_q09/datafusion:vortex-compact 868570475 980761041 0.89
tpch_q10/datafusion:vortex-compact 827682680 692281998 1.20
tpch_q11/datafusion:vortex-compact 527342774 515116937 1.02
tpch_q12/datafusion:vortex-compact 521780591 718163983 0.73
tpch_q13/datafusion:vortex-compact 🚀 259612910 483431004 0.54
tpch_q14/datafusion:vortex-compact 🚀 282589852 598282110 0.47
tpch_q15/datafusion:vortex-compact 587383577 663051311 0.89
tpch_q16/datafusion:vortex-compact 301160074 340803931 0.88
tpch_q17/datafusion:vortex-compact 786804279 763363286 1.03
tpch_q18/datafusion:vortex-compact 875476580 898806282 0.97
tpch_q19/datafusion:vortex-compact 724796079 867809837 0.84
tpch_q20/datafusion:vortex-compact 638996754 724601017 0.88
tpch_q21/datafusion:vortex-compact 927611108 971002704 0.96
tpch_q22/datafusion:vortex-compact 389960172 368817452 1.06
datafusion / parquet / ns (1.032x ➖, 1↑ 2↓)
name PR 3062ebb (ns) base adab5b8 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 428432764 419710554 1.02
tpch_q02/datafusion:parquet 714860109 739095353 0.97
tpch_q03/datafusion:parquet 853389281 681030449 1.25
tpch_q04/datafusion:parquet 🚨 496682104 306174422 1.62
tpch_q05/datafusion:parquet 891684107 784683932 1.14
tpch_q06/datafusion:parquet 🚨 346881248 261524374 1.33
tpch_q07/datafusion:parquet 921866748 893481344 1.03
tpch_q08/datafusion:parquet 1084492654 1022848950 1.06
tpch_q09/datafusion:parquet 1463252515 1326249157 1.10
tpch_q10/datafusion:parquet 1740062469 1953669093 0.89
tpch_q11/datafusion:parquet 🚀 441282408 680764427 0.65
tpch_q12/datafusion:parquet 451314438 439300618 1.03
tpch_q13/datafusion:parquet 607545986 652852514 0.93
tpch_q14/datafusion:parquet 424161452 430178182 0.99
tpch_q15/datafusion:parquet 732918007 666216678 1.10
tpch_q16/datafusion:parquet 366689315 340699371 1.08
tpch_q17/datafusion:parquet 836494086 831401937 1.01
tpch_q18/datafusion:parquet 1136430449 1260052381 0.90
tpch_q19/datafusion:parquet 532172725 530731642 1.00
tpch_q20/datafusion:parquet 979087967 948772099 1.03
tpch_q21/datafusion:parquet 1201663151 1292631156 0.93
tpch_q22/datafusion:parquet 697553551 721747281 0.97
duckdb / vortex-compact / ns (0.961x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base adab5b8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 630749820 639948853 0.99
tpch_q02/duckdb:vortex-compact 837215108 805594904 1.04
tpch_q03/duckdb:vortex-compact 812893316 801559264 1.01
tpch_q04/duckdb:vortex-compact 746503132 1040939736 0.72
tpch_q05/duckdb:vortex-compact 1046682775 997771562 1.05
tpch_q06/duckdb:vortex-compact 690757305 691975893 1.00
tpch_q07/duckdb:vortex-compact 1086524010 1169103549 0.93
tpch_q08/duckdb:vortex-compact 1324483882 1348895100 0.98
tpch_q09/duckdb:vortex-compact 1319900343 1616821195 0.82
tpch_q10/duckdb:vortex-compact 1222073566 1235003558 0.99
tpch_q11/duckdb:vortex-compact 461655155 474413114 0.97
tpch_q12/duckdb:vortex-compact 1180787236 1227566807 0.96
tpch_q13/duckdb:vortex-compact 893272969 694374516 1.29
tpch_q14/duckdb:vortex-compact 596229728 622426892 0.96
tpch_q15/duckdb:vortex-compact 572638748 558886903 1.02
tpch_q16/duckdb:vortex-compact 322365383 316669994 1.02
tpch_q17/duckdb:vortex-compact 1021035617 959185067 1.06
tpch_q18/duckdb:vortex-compact 729156488 815490812 0.89
tpch_q19/duckdb:vortex-compact 790157058 865942603 0.91
tpch_q20/duckdb:vortex-compact 1068723919 1086591563 0.98
tpch_q21/duckdb:vortex-compact 1750616437 1815250934 0.96
tpch_q22/duckdb:vortex-compact 285533936 389491629 0.73
duckdb / parquet / ns (1.010x ➖, 0↑ 1↓)
name PR 3062ebb (ns) base adab5b8 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 577157745 690848290 0.84
tpch_q02/duckdb:parquet 905017988 965589083 0.94
tpch_q03/duckdb:parquet 1397862381 1241369043 1.13
tpch_q04/duckdb:parquet 786414609 794569045 0.99
tpch_q05/duckdb:parquet 1406267726 1354796913 1.04
tpch_q06/duckdb:parquet 🚨 637519663 487213503 1.31
tpch_q07/duckdb:parquet 1347767404 1166389483 1.16
tpch_q08/duckdb:parquet 1792010705 1670952459 1.07
tpch_q09/duckdb:parquet 1903878484 1667892133 1.14
tpch_q10/duckdb:parquet 2675484086 2643025586 1.01
tpch_q11/duckdb:parquet 578675477 564902164 1.02
tpch_q12/duckdb:parquet 831567728 894994209 0.93
tpch_q13/duckdb:parquet 1099093504 1103820540 1.00
tpch_q14/duckdb:parquet 727908148 929837082 0.78
tpch_q15/duckdb:parquet 513291637 517981769 0.99
tpch_q16/duckdb:parquet 722518487 818065814 0.88
tpch_q17/duckdb:parquet 778704661 690929766 1.13
tpch_q18/duckdb:parquet 1098499263 1158229555 0.95
tpch_q19/duckdb:parquet 1054062728 1095984643 0.96
tpch_q20/duckdb:parquet 1445563152 1340968495 1.08
tpch_q21/duckdb:parquet 1130909427 1140928541 0.99
tpch_q22/duckdb:parquet 987921543 969118361 1.02

@joseph-isaacs
joseph-isaacs force-pushed the claude/layoutreader-v1-scan-perf-0l1nci branch from ec8e480 to cad24dc Compare August 7, 2026 14:05
@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (+0.3%, environment too noisy confidence) · DuckDB No clear signal (+1.2%, low confidence)
Vortex (geomean): 1.007x ➖
Parquet (geomean): 1.000x ➖
Shifts: Parquet (control) -0.0% · Median polish +0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base 39fde8c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 43477172 43618285 1.00
tpch_q02/datafusion:vortex-file-compressed 23081160 22911289 1.01
tpch_q03/datafusion:vortex-file-compressed 30242052 30246143 1.00
tpch_q04/datafusion:vortex-file-compressed 16806568 15629808 1.08
tpch_q05/datafusion:vortex-file-compressed 48988797 50156131 0.98
tpch_q06/datafusion:vortex-file-compressed 8647298 8291863 1.04
tpch_q07/datafusion:vortex-file-compressed 56091001 56759540 0.99
tpch_q08/datafusion:vortex-file-compressed 45272850 45902268 0.99
tpch_q09/datafusion:vortex-file-compressed 56790187 57330568 0.99
tpch_q10/datafusion:vortex-file-compressed 28686270 29171644 0.98
tpch_q11/datafusion:vortex-file-compressed 17933473 17750685 1.01
tpch_q12/datafusion:vortex-file-compressed 28246051 27866683 1.01
tpch_q13/datafusion:vortex-file-compressed 25081766 24709453 1.02
tpch_q14/datafusion:vortex-file-compressed 15043039 14929735 1.01
tpch_q15/datafusion:vortex-file-compressed 21468163 21146386 1.02
tpch_q16/datafusion:vortex-file-compressed 24545372 24398446 1.01
tpch_q17/datafusion:vortex-file-compressed 55378326 56271976 0.98
tpch_q18/datafusion:vortex-file-compressed 69299422 68581843 1.01
tpch_q19/datafusion:vortex-file-compressed 18666302 19139698 0.98
tpch_q20/datafusion:vortex-file-compressed 32385460 32406950 1.00
tpch_q21/datafusion:vortex-file-compressed 62571644 61175926 1.02
tpch_q22/datafusion:vortex-file-compressed 12489832 12049511 1.04
datafusion / vortex-compact / ns (1.009x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base 39fde8c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 48307499 48476064 1.00
tpch_q02/datafusion:vortex-compact 27331042 27100469 1.01
tpch_q03/datafusion:vortex-compact 31855496 32111363 0.99
tpch_q04/datafusion:vortex-compact 17940960 17107549 1.05
tpch_q05/datafusion:vortex-compact 50790758 52041432 0.98
tpch_q06/datafusion:vortex-compact 10044992 9781400 1.03
tpch_q07/datafusion:vortex-compact 58084171 57350503 1.01
tpch_q08/datafusion:vortex-compact 48848064 48269558 1.01
tpch_q09/datafusion:vortex-compact 59132642 60183246 0.98
tpch_q10/datafusion:vortex-compact 34981891 34200920 1.02
tpch_q11/datafusion:vortex-compact 19427782 19862581 0.98
tpch_q12/datafusion:vortex-compact 31550488 31963128 0.99
tpch_q13/datafusion:vortex-compact 28215471 28067671 1.01
tpch_q14/datafusion:vortex-compact 17975183 17179061 1.05
tpch_q15/datafusion:vortex-compact 25934455 25546284 1.02
tpch_q16/datafusion:vortex-compact 29000699 28605214 1.01
tpch_q17/datafusion:vortex-compact 58259669 58987747 0.99
tpch_q18/datafusion:vortex-compact 68509320 69290690 0.99
tpch_q19/datafusion:vortex-compact 34416190 31942166 1.08
tpch_q20/datafusion:vortex-compact 34834089 34430716 1.01
tpch_q21/datafusion:vortex-compact 66282217 65755274 1.01
tpch_q22/datafusion:vortex-compact 13319914 13145241 1.01
datafusion / parquet / ns (1.004x ➖, 1↑ 1↓)
name PR 3062ebb (ns) base 39fde8c (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 109602826 126256563 0.87
tpch_q02/datafusion:parquet 71402318 70671192 1.01
tpch_q03/datafusion:parquet 103681548 95557728 1.09
tpch_q04/datafusion:parquet 51436254 52274964 0.98
tpch_q05/datafusion:parquet 122994568 126466281 0.97
tpch_q06/datafusion:parquet 🚨 47587494 40305517 1.18
tpch_q07/datafusion:parquet 131311285 131898665 1.00
tpch_q08/datafusion:parquet 125686081 128262444 0.98
tpch_q09/datafusion:parquet 148012872 162014002 0.91
tpch_q10/datafusion:parquet 128329245 119203560 1.08
tpch_q11/datafusion:parquet 50305166 50055174 1.00
tpch_q12/datafusion:parquet 105820193 103601228 1.02
tpch_q13/datafusion:parquet 228067096 225041372 1.01
tpch_q14/datafusion:parquet 54414709 52922553 1.03
tpch_q15/datafusion:parquet 66087453 70111940 0.94
tpch_q16/datafusion:parquet 49076538 49178932 1.00
tpch_q17/datafusion:parquet 145822994 154055942 0.95
tpch_q18/datafusion:parquet 183272498 182518768 1.00
tpch_q19/datafusion:parquet 80941174 75143297 1.08
tpch_q20/datafusion:parquet 95313195 93984486 1.01
tpch_q21/datafusion:parquet 175742754 171421080 1.03
tpch_q22/datafusion:parquet 57184997 57241397 1.00
duckdb / vortex-file-compressed / ns (1.006x ➖, 0↑ 1↓)
name PR 3062ebb (ns) base 39fde8c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 24411077 24572952 0.99
tpch_q02/duckdb:vortex-file-compressed 33801424 34771426 0.97
tpch_q03/duckdb:vortex-file-compressed 41003379 39059616 1.05
tpch_q04/duckdb:vortex-file-compressed 33358878 32720591 1.02
tpch_q05/duckdb:vortex-file-compressed 44614521 45175876 0.99
tpch_q06/duckdb:vortex-file-compressed 🚨 13612795 12181758 1.12
tpch_q07/duckdb:vortex-file-compressed 45415887 45534158 1.00
tpch_q08/duckdb:vortex-file-compressed 54648361 54430006 1.00
tpch_q09/duckdb:vortex-file-compressed 65750745 62882427 1.05
tpch_q10/duckdb:vortex-file-compressed 55779483 54687905 1.02
tpch_q11/duckdb:vortex-file-compressed 18787092 19410628 0.97
tpch_q12/duckdb:vortex-file-compressed 30656119 30896494 0.99
tpch_q13/duckdb:vortex-file-compressed 46701185 43604760 1.07
tpch_q14/duckdb:vortex-file-compressed 21979152 23273301 0.94
tpch_q15/duckdb:vortex-file-compressed 21163505 22041700 0.96
tpch_q16/duckdb:vortex-file-compressed 34334211 32848860 1.05
tpch_q17/duckdb:vortex-file-compressed 33905227 36023657 0.94
tpch_q18/duckdb:vortex-file-compressed 52666435 54080302 0.97
tpch_q19/duckdb:vortex-file-compressed 38564950 38803899 0.99
tpch_q20/duckdb:vortex-file-compressed 39630079 39727449 1.00
tpch_q21/duckdb:vortex-file-compressed 127901861 127749369 1.00
tpch_q22/duckdb:vortex-file-compressed 23517264 22172056 1.06
duckdb / vortex-compact / ns (1.007x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base 39fde8c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 29595399 29078128 1.02
tpch_q02/duckdb:vortex-compact 42165012 41088496 1.03
tpch_q03/duckdb:vortex-compact 38645904 41191579 0.94
tpch_q04/duckdb:vortex-compact 34113786 34022310 1.00
tpch_q05/duckdb:vortex-compact 44899968 45181702 0.99
tpch_q06/duckdb:vortex-compact 14694488 14286759 1.03
tpch_q07/duckdb:vortex-compact 45551219 46262470 0.98
tpch_q08/duckdb:vortex-compact 56175241 58449856 0.96
tpch_q09/duckdb:vortex-compact 63878822 64922751 0.98
tpch_q10/duckdb:vortex-compact 56949474 55940542 1.02
tpch_q11/duckdb:vortex-compact 19989581 19312282 1.04
tpch_q12/duckdb:vortex-compact 33355097 31684046 1.05
tpch_q13/duckdb:vortex-compact 45332584 46554927 0.97
tpch_q14/duckdb:vortex-compact 25821591 25356766 1.02
tpch_q15/duckdb:vortex-compact 22684556 21755914 1.04
tpch_q16/duckdb:vortex-compact 34764596 36103290 0.96
tpch_q17/duckdb:vortex-compact 37398223 37063406 1.01
tpch_q18/duckdb:vortex-compact 55672316 55299267 1.01
tpch_q19/duckdb:vortex-compact 41118565 39121717 1.05
tpch_q20/duckdb:vortex-compact 47428183 45617856 1.04
tpch_q21/duckdb:vortex-compact 124695546 121383832 1.03
tpch_q22/duckdb:vortex-compact 23472715 23900395 0.98
duckdb / parquet / ns (0.995x ➖, 1↑ 0↓)
name PR 3062ebb (ns) base 39fde8c (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 81582831 81470107 1.00
tpch_q02/duckdb:parquet 45686977 45753449 1.00
tpch_q03/duckdb:parquet 80594842 80932315 1.00
tpch_q04/duckdb:parquet 58005977 58184259 1.00
tpch_q05/duckdb:parquet 77987857 77657898 1.00
tpch_q06/duckdb:parquet 24880911 24907426 1.00
tpch_q07/duckdb:parquet 80086582 79072931 1.01
tpch_q08/duckdb:parquet 96507128 96762313 1.00
tpch_q09/duckdb:parquet 148236009 147886879 1.00
tpch_q10/duckdb:parquet 141904228 142106328 1.00
tpch_q11/duckdb:parquet 🚀 25215407 28568868 0.88
tpch_q12/duckdb:parquet 52936335 52985328 1.00
tpch_q13/duckdb:parquet 287721231 289038774 1.00
tpch_q14/duckdb:parquet 55650802 55941963 0.99
tpch_q15/duckdb:parquet 30310987 30595211 0.99
tpch_q16/duckdb:parquet 66413085 66503339 1.00
tpch_q17/duckdb:parquet 57776794 57859114 1.00
tpch_q18/duckdb:parquet 126448325 127696920 0.99
tpch_q19/duckdb:parquet 77069897 77033077 1.00
tpch_q20/duckdb:parquet 77799558 77014325 1.01
tpch_q21/duckdb:parquet 196169128 189276391 1.04
tpch_q22/duckdb:parquet 64020473 64439779 0.99

No file size changes detected.

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.0%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (+1.5%, low confidence)
Vortex (geomean): 1.013x ➖
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.008x ➖, 0↑ 1↓)
name PR 3062ebb (ns) base 39fde8c (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 28757342 27875498 1.03
tpcds_q02/datafusion:vortex-file-compressed 52586499 52565216 1.00
tpcds_q03/datafusion:vortex-file-compressed 13768174 14304074 0.96
tpcds_q04/datafusion:vortex-file-compressed 220620012 221376495 1.00
tpcds_q05/datafusion:vortex-file-compressed 65761569 64059567 1.03
tpcds_q06/datafusion:vortex-file-compressed 26525002 26452853 1.00
tpcds_q07/datafusion:vortex-file-compressed 43105613 42311347 1.02
tpcds_q08/datafusion:vortex-file-compressed 33465438 33563220 1.00
tpcds_q09/datafusion:vortex-file-compressed 26333465 26573997 0.99
tpcds_q10/datafusion:vortex-file-compressed 35875858 35592254 1.01
tpcds_q11/datafusion:vortex-file-compressed 113681382 116089460 0.98
tpcds_q12/datafusion:vortex-file-compressed 21951301 21445687 1.02
tpcds_q13/datafusion:vortex-file-compressed 47405057 45881258 1.03
tpcds_q14/datafusion:vortex-file-compressed 205385485 200976858 1.02
tpcds_q15/datafusion:vortex-file-compressed 30297260 29118334 1.04
tpcds_q16/datafusion:vortex-file-compressed 24508926 24635779 0.99
tpcds_q17/datafusion:vortex-file-compressed 71740611 73090831 0.98
tpcds_q18/datafusion:vortex-file-compressed 92113453 90745052 1.02
tpcds_q19/datafusion:vortex-file-compressed 21504649 21541416 1.00
tpcds_q20/datafusion:vortex-file-compressed 21924018 21718325 1.01
tpcds_q21/datafusion:vortex-file-compressed 34803775 33058955 1.05
tpcds_q22/datafusion:vortex-file-compressed 128303264 128298834 1.00
tpcds_q23/datafusion:vortex-file-compressed 130145815 133132410 0.98
tpcds_q24/datafusion:vortex-file-compressed 96942037 96959941 1.00
tpcds_q25/datafusion:vortex-file-compressed 75018146 75023329 1.00
tpcds_q26/datafusion:vortex-file-compressed 37104566 36702669 1.01
tpcds_q27/datafusion:vortex-file-compressed 95187187 96374213 0.99
tpcds_q28/datafusion:vortex-file-compressed 27792330 27671040 1.00
tpcds_q29/datafusion:vortex-file-compressed 69655735 71469576 0.97
tpcds_q30/datafusion:vortex-file-compressed 28811186 29103786 0.99
tpcds_q31/datafusion:vortex-file-compressed 76362457 79415730 0.96
tpcds_q32/datafusion:vortex-file-compressed 18057912 18269863 0.99
tpcds_q33/datafusion:vortex-file-compressed 32639289 32561066 1.00
tpcds_q34/datafusion:vortex-file-compressed 26454456 25621658 1.03
tpcds_q35/datafusion:vortex-file-compressed 44958953 43518706 1.03
tpcds_q36/datafusion:vortex-file-compressed 63625775 65553938 0.97
tpcds_q37/datafusion:vortex-file-compressed 19669219 18212565 1.08
tpcds_q38/datafusion:vortex-file-compressed 40635550 38772430 1.05
tpcds_q39/datafusion:vortex-file-compressed 102107818 107476921 0.95
tpcds_q40/datafusion:vortex-file-compressed 33795841 33184799 1.02
tpcds_q41/datafusion:vortex-file-compressed 24218121 23866883 1.01
tpcds_q42/datafusion:vortex-file-compressed 13649134 13388042 1.02
tpcds_q43/datafusion:vortex-file-compressed 19250168 19157425 1.00
tpcds_q44/datafusion:vortex-file-compressed 33969843 34753570 0.98
tpcds_q45/datafusion:vortex-file-compressed 32704018 32972034 0.99
tpcds_q46/datafusion:vortex-file-compressed 🚨 40387366 35597835 1.13
tpcds_q47/datafusion:vortex-file-compressed 129682122 128555764 1.01
tpcds_q48/datafusion:vortex-file-compressed 40006101 38964480 1.03
tpcds_q49/datafusion:vortex-file-compressed 71258955 71609463 1.00
tpcds_q50/datafusion:vortex-file-compressed 48001255 46611245 1.03
tpcds_q51/datafusion:vortex-file-compressed 78150810 76990437 1.02
tpcds_q52/datafusion:vortex-file-compressed 14239340 14309191 1.00
tpcds_q53/datafusion:vortex-file-compressed 23707562 23918662 0.99
tpcds_q54/datafusion:vortex-file-compressed 37290967 38016357 0.98
tpcds_q55/datafusion:vortex-file-compressed 13811238 13642231 1.01
tpcds_q56/datafusion:vortex-file-compressed 32993414 32814432 1.01
tpcds_q57/datafusion:vortex-file-compressed 106782366 100345599 1.06
tpcds_q58/datafusion:vortex-file-compressed 60779139 62472806 0.97
tpcds_q59/datafusion:vortex-file-compressed 55625495 55887530 1.00
tpcds_q60/datafusion:vortex-file-compressed 32708241 32860476 1.00
tpcds_q61/datafusion:vortex-file-compressed 38385260 36602409 1.05
tpcds_q62/datafusion:vortex-file-compressed 24708085 24385797 1.01
tpcds_q63/datafusion:vortex-file-compressed 24296954 24265135 1.00
tpcds_q64/datafusion:vortex-file-compressed 470382935 464236690 1.01
tpcds_q65/datafusion:vortex-file-compressed 69949699 70154965 1.00
tpcds_q66/datafusion:vortex-file-compressed 76912550 78369814 0.98
tpcds_q67/datafusion:vortex-file-compressed 118892931 116356138 1.02
tpcds_q68/datafusion:vortex-file-compressed 34020305 32879171 1.03
tpcds_q69/datafusion:vortex-file-compressed 34418791 33501939 1.03
tpcds_q70/datafusion:vortex-file-compressed 120391623 109564856 1.10
tpcds_q71/datafusion:vortex-file-compressed 22807103 23853254 0.96
tpcds_q72/datafusion:vortex-file-compressed 1449078937 1479176190 0.98
tpcds_q73/datafusion:vortex-file-compressed 25854729 26540791 0.97
tpcds_q74/datafusion:vortex-file-compressed 78541172 74095508 1.06
tpcds_q75/datafusion:vortex-file-compressed 149440892 163391329 0.91
tpcds_q76/datafusion:vortex-file-compressed 41497860 41919569 0.99
tpcds_q77/datafusion:vortex-file-compressed 43894911 44226272 0.99
tpcds_q78/datafusion:vortex-file-compressed 108400471 108150666 1.00
tpcds_q79/datafusion:vortex-file-compressed 28146483 28144316 1.00
tpcds_q80/datafusion:vortex-file-compressed 99466608 102496149 0.97
tpcds_q81/datafusion:vortex-file-compressed 32198275 29466183 1.09
tpcds_q82/datafusion:vortex-file-compressed 19415474 18670884 1.04
tpcds_q83/datafusion:vortex-file-compressed 41975894 41938325 1.00
tpcds_q84/datafusion:vortex-file-compressed 12896621 13947485 0.92
tpcds_q85/datafusion:vortex-file-compressed 111358036 111360785 1.00
tpcds_q86/datafusion:vortex-file-compressed 18637492 18242677 1.02
tpcds_q87/datafusion:vortex-file-compressed 41274114 41260507 1.00
tpcds_q88/datafusion:vortex-file-compressed 52739122 53493607 0.99
tpcds_q89/datafusion:vortex-file-compressed 28482816 27754001 1.03
tpcds_q90/datafusion:vortex-file-compressed 14163360 14033932 1.01
tpcds_q91/datafusion:vortex-file-compressed 20245184 19384755 1.04
tpcds_q92/datafusion:vortex-file-compressed 17652513 17119985 1.03
tpcds_q93/datafusion:vortex-file-compressed 31511513 30937312 1.02
tpcds_q94/datafusion:vortex-file-compressed 23119818 23378999 0.99
tpcds_q95/datafusion:vortex-file-compressed 62951062 64703755 0.97
tpcds_q96/datafusion:vortex-file-compressed 11644011 11826325 0.98
tpcds_q97/datafusion:vortex-file-compressed 27945167 27814388 1.00
tpcds_q98/datafusion:vortex-file-compressed 25639673 24420246 1.05
tpcds_q99/datafusion:vortex-file-compressed 28265010 26201979 1.08
datafusion / vortex-compact / ns (1.008x ➖, 1↑ 2↓)
name PR 3062ebb (ns) base 39fde8c (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 30693276 30224802 1.02
tpcds_q02/datafusion:vortex-compact 57869721 58274432 0.99
tpcds_q03/datafusion:vortex-compact 17965773 16405165 1.10
tpcds_q04/datafusion:vortex-compact 246634465 244564375 1.01
tpcds_q05/datafusion:vortex-compact 66419096 65963934 1.01
tpcds_q06/datafusion:vortex-compact 29650558 29561057 1.00
tpcds_q07/datafusion:vortex-compact 56668141 58889802 0.96
tpcds_q08/datafusion:vortex-compact 43080961 41092805 1.05
tpcds_q09/datafusion:vortex-compact 42497790 42750051 0.99
tpcds_q10/datafusion:vortex-compact 54149607 53077760 1.02
tpcds_q11/datafusion:vortex-compact 137040098 132184456 1.04
tpcds_q12/datafusion:vortex-compact 25416980 25471973 1.00
tpcds_q13/datafusion:vortex-compact 114743413 112163802 1.02
tpcds_q14/datafusion:vortex-compact 220815592 234044936 0.94
tpcds_q15/datafusion:vortex-compact 34472272 34234528 1.01
tpcds_q16/datafusion:vortex-compact 31618704 31286377 1.01
tpcds_q17/datafusion:vortex-compact 111694628 110520302 1.01
tpcds_q18/datafusion:vortex-compact 102196170 101590699 1.01
tpcds_q19/datafusion:vortex-compact 30192802 30565435 0.99
tpcds_q20/datafusion:vortex-compact 27491608 26919294 1.02
tpcds_q21/datafusion:vortex-compact 35121366 35259065 1.00
tpcds_q22/datafusion:vortex-compact 119864464 127245893 0.94
tpcds_q23/datafusion:vortex-compact 145615765 139415892 1.04
tpcds_q24/datafusion:vortex-compact 114902186 113331683 1.01
tpcds_q25/datafusion:vortex-compact 84523921 81794780 1.03
tpcds_q26/datafusion:vortex-compact 50637919 52971286 0.96
tpcds_q27/datafusion:vortex-compact 119528981 118139836 1.01
tpcds_q28/datafusion:vortex-compact 64679481 61267496 1.06
tpcds_q29/datafusion:vortex-compact 84558324 83428452 1.01
tpcds_q30/datafusion:vortex-compact 34738676 33748877 1.03
tpcds_q31/datafusion:vortex-compact 100942135 100022852 1.01
tpcds_q32/datafusion:vortex-compact 22294813 22324037 1.00
tpcds_q33/datafusion:vortex-compact 39432353 39544817 1.00
tpcds_q34/datafusion:vortex-compact 37114367 37831194 0.98
tpcds_q35/datafusion:vortex-compact 58506648 58258482 1.00
tpcds_q36/datafusion:vortex-compact 76687997 74303002 1.03
tpcds_q37/datafusion:vortex-compact 25023147 25205241 0.99
tpcds_q38/datafusion:vortex-compact 51539599 49420188 1.04
tpcds_q39/datafusion:vortex-compact 103706197 111214023 0.93
tpcds_q40/datafusion:vortex-compact 37158922 36555615 1.02
tpcds_q41/datafusion:vortex-compact 27056832 26167999 1.03
tpcds_q42/datafusion:vortex-compact 16652439 16463315 1.01
tpcds_q43/datafusion:vortex-compact 24419979 24591586 0.99
tpcds_q44/datafusion:vortex-compact 48487412 49968137 0.97
tpcds_q45/datafusion:vortex-compact 39661885 39175127 1.01
tpcds_q46/datafusion:vortex-compact 46800309 46233741 1.01
tpcds_q47/datafusion:vortex-compact 143955563 140124093 1.03
tpcds_q48/datafusion:vortex-compact 🚨 100378800 88297352 1.14
tpcds_q49/datafusion:vortex-compact 84017575 84633401 0.99
tpcds_q50/datafusion:vortex-compact 57788142 53990108 1.07
tpcds_q51/datafusion:vortex-compact 82655961 79644269 1.04
tpcds_q52/datafusion:vortex-compact 17502277 17259909 1.01
tpcds_q53/datafusion:vortex-compact 30715139 28394987 1.08
tpcds_q54/datafusion:vortex-compact 45244139 45821829 0.99
tpcds_q55/datafusion:vortex-compact 🚀 16834771 18872686 0.89
tpcds_q56/datafusion:vortex-compact 40707062 39340725 1.03
tpcds_q57/datafusion:vortex-compact 108300933 111741297 0.97
tpcds_q58/datafusion:vortex-compact 68870016 67623000 1.02
tpcds_q59/datafusion:vortex-compact 62223504 62715258 0.99
tpcds_q60/datafusion:vortex-compact 39041838 38986605 1.00
tpcds_q61/datafusion:vortex-compact 47246492 48382281 0.98
tpcds_q62/datafusion:vortex-compact 28105487 27164953 1.03
tpcds_q63/datafusion:vortex-compact 29085860 28872055 1.01
tpcds_q64/datafusion:vortex-compact 503205324 528442680 0.95
tpcds_q65/datafusion:vortex-compact 82891724 83956258 0.99
tpcds_q66/datafusion:vortex-compact 82998407 82347522 1.01
tpcds_q67/datafusion:vortex-compact 120399232 117256330 1.03
tpcds_q68/datafusion:vortex-compact 🚨 52751298 45878847 1.15
tpcds_q69/datafusion:vortex-compact 52053745 51049482 1.02
tpcds_q70/datafusion:vortex-compact 116122392 117329331 0.99
tpcds_q71/datafusion:vortex-compact 29504199 30630788 0.96
tpcds_q72/datafusion:vortex-compact 1488017588 1508091169 0.99
tpcds_q73/datafusion:vortex-compact 34104185 35112656 0.97
tpcds_q74/datafusion:vortex-compact 87972509 87933384 1.00
tpcds_q75/datafusion:vortex-compact 151131423 150863546 1.00
tpcds_q76/datafusion:vortex-compact 48522631 48048383 1.01
tpcds_q77/datafusion:vortex-compact 50844739 50188231 1.01
tpcds_q78/datafusion:vortex-compact 131253375 132983766 0.99
tpcds_q79/datafusion:vortex-compact 39771346 39352207 1.01
tpcds_q80/datafusion:vortex-compact 111660766 107407362 1.04
tpcds_q81/datafusion:vortex-compact 34015054 33130241 1.03
tpcds_q82/datafusion:vortex-compact 26166268 26217198 1.00
tpcds_q83/datafusion:vortex-compact 43097827 43540037 0.99
tpcds_q84/datafusion:vortex-compact 14465886 14518612 1.00
tpcds_q85/datafusion:vortex-compact 166909584 159740042 1.04
tpcds_q86/datafusion:vortex-compact 19978897 20626117 0.97
tpcds_q87/datafusion:vortex-compact 51933951 54392906 0.95
tpcds_q88/datafusion:vortex-compact 83734901 81383813 1.03
tpcds_q89/datafusion:vortex-compact 33946172 32435161 1.05
tpcds_q90/datafusion:vortex-compact 16539792 16470412 1.00
tpcds_q91/datafusion:vortex-compact 41271039 42317901 0.98
tpcds_q92/datafusion:vortex-compact 21603877 21125228 1.02
tpcds_q93/datafusion:vortex-compact 40574717 37394533 1.09
tpcds_q94/datafusion:vortex-compact 28274462 28480152 0.99
tpcds_q95/datafusion:vortex-compact 67993702 69881649 0.97
tpcds_q96/datafusion:vortex-compact 17020318 18040978 0.94
tpcds_q97/datafusion:vortex-compact 35187790 34148033 1.03
tpcds_q98/datafusion:vortex-compact 30883165 30679650 1.01
tpcds_q99/datafusion:vortex-compact 31624540 29412446 1.08
datafusion / parquet / ns (1.003x ➖, 1↑ 0↓)
name PR 3062ebb (ns) base 39fde8c (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 30696966 30148809 1.02
tpcds_q02/datafusion:parquet 52906356 52916850 1.00
tpcds_q03/datafusion:parquet 17199459 17076163 1.01
tpcds_q04/datafusion:parquet 336767881 338590415 0.99
tpcds_q05/datafusion:parquet 81696981 77443091 1.05
tpcds_q06/datafusion:parquet 31080015 30466482 1.02
tpcds_q07/datafusion:parquet 100106799 98626545 1.02
tpcds_q08/datafusion:parquet 37962181 37809836 1.00
tpcds_q09/datafusion:parquet 38349103 36009411 1.06
tpcds_q10/datafusion:parquet 88816276 89992766 0.99
tpcds_q11/datafusion:parquet 162915799 167868247 0.97
tpcds_q12/datafusion:parquet 22129673 23917042 0.93
tpcds_q13/datafusion:parquet 95479823 97168397 0.98
tpcds_q14/datafusion:parquet 267818102 279729952 0.96
tpcds_q15/datafusion:parquet 36849066 37504689 0.98
tpcds_q16/datafusion:parquet 47130044 47340479 1.00
tpcds_q17/datafusion:parquet 108276698 107975021 1.00
tpcds_q18/datafusion:parquet 133578913 135223918 0.99
tpcds_q19/datafusion:parquet 28848687 28481557 1.01
tpcds_q20/datafusion:parquet 23830471 24157596 0.99
tpcds_q21/datafusion:parquet 22299609 21855911 1.02
tpcds_q22/datafusion:parquet 🚀 104671337 128941720 0.81
tpcds_q23/datafusion:parquet 173274560 178095475 0.97
tpcds_q24/datafusion:parquet 138695353 134197479 1.03
tpcds_q25/datafusion:parquet 105743237 106216369 1.00
tpcds_q26/datafusion:parquet 84628947 88836013 0.95
tpcds_q27/datafusion:parquet 160189844 160180082 1.00
tpcds_q28/datafusion:parquet 42097117 41416364 1.02
tpcds_q29/datafusion:parquet 106862508 108604894 0.98
tpcds_q30/datafusion:parquet 44885427 43783814 1.03
tpcds_q31/datafusion:parquet 93436636 93622884 1.00
tpcds_q32/datafusion:parquet 23932329 23328475 1.03
tpcds_q33/datafusion:parquet 37583137 38110965 0.99
tpcds_q34/datafusion:parquet 29697007 29638404 1.00
tpcds_q35/datafusion:parquet 93997245 94351186 1.00
tpcds_q36/datafusion:parquet 69724019 68929837 1.01
tpcds_q37/datafusion:parquet 24927659 24307052 1.03
tpcds_q38/datafusion:parquet 58588944 57250364 1.02
tpcds_q39/datafusion:parquet 82969342 81761095 1.01
tpcds_q40/datafusion:parquet 35025556 34621652 1.01
tpcds_q41/datafusion:parquet 19881662 19146671 1.04
tpcds_q42/datafusion:parquet 16648378 16092774 1.03
tpcds_q43/datafusion:parquet 23679400 22706921 1.04
tpcds_q44/datafusion:parquet 39912759 42369176 0.94
tpcds_q45/datafusion:parquet 44255995 45450119 0.97
tpcds_q46/datafusion:parquet 44533714 41428429 1.07
tpcds_q47/datafusion:parquet 149264930 150455437 0.99
tpcds_q48/datafusion:parquet 88563238 86775086 1.02
tpcds_q49/datafusion:parquet 79092592 76303739 1.04
tpcds_q50/datafusion:parquet 76696556 75059897 1.02
tpcds_q51/datafusion:parquet 82838441 82740630 1.00
tpcds_q52/datafusion:parquet 16533213 17303763 0.96
tpcds_q53/datafusion:parquet 24849109 25395755 0.98
tpcds_q54/datafusion:parquet 50411200 46514980 1.08
tpcds_q55/datafusion:parquet 16016672 16154735 0.99
tpcds_q56/datafusion:parquet 36638050 36907732 0.99
tpcds_q57/datafusion:parquet 123691071 131853933 0.94
tpcds_q58/datafusion:parquet 82595159 82547405 1.00
tpcds_q59/datafusion:parquet 77153172 75682394 1.02
tpcds_q60/datafusion:parquet 36558803 37970843 0.96
tpcds_q61/datafusion:parquet 44726220 45931543 0.97
tpcds_q62/datafusion:parquet 29184080 27947023 1.04
tpcds_q63/datafusion:parquet 24715275 25109018 0.98
tpcds_q64/datafusion:parquet 362087507 362311853 1.00
tpcds_q65/datafusion:parquet 49354987 48453294 1.02
tpcds_q66/datafusion:parquet 89395713 81396247 1.10
tpcds_q67/datafusion:parquet 144230206 142931823 1.01
tpcds_q68/datafusion:parquet 41458653 41075595 1.01
tpcds_q69/datafusion:parquet 87810321 82833709 1.06
tpcds_q70/datafusion:parquet 45066417 44752519 1.01
tpcds_q71/datafusion:parquet 27434358 26464489 1.04
tpcds_q72/datafusion:parquet 446302502 439182740 1.02
tpcds_q73/datafusion:parquet 28221318 28485999 0.99
tpcds_q74/datafusion:parquet 106536392 103624296 1.03
tpcds_q75/datafusion:parquet 174203006 178491573 0.98
tpcds_q76/datafusion:parquet 57616643 57929131 0.99
tpcds_q77/datafusion:parquet 56925671 56690598 1.00
tpcds_q78/datafusion:parquet 128418253 127789675 1.00
tpcds_q79/datafusion:parquet 34075200 34360172 0.99
tpcds_q80/datafusion:parquet 101157106 97898723 1.03
tpcds_q81/datafusion:parquet 39230347 39197801 1.00
tpcds_q82/datafusion:parquet 24003833 23364837 1.03
tpcds_q83/datafusion:parquet 58502617 55574219 1.05
tpcds_q84/datafusion:parquet 48249588 49284818 0.98
tpcds_q85/datafusion:parquet 197966053 194292700 1.02
tpcds_q86/datafusion:parquet 20986129 20850733 1.01
tpcds_q87/datafusion:parquet 61408091 59626802 1.03
tpcds_q88/datafusion:parquet 58698792 60917180 0.96
tpcds_q89/datafusion:parquet 30500222 30250198 1.01
tpcds_q90/datafusion:parquet 19262639 19126963 1.01
tpcds_q91/datafusion:parquet 64669964 65278624 0.99
tpcds_q92/datafusion:parquet 25086739 24607282 1.02
tpcds_q93/datafusion:parquet 37960965 39369186 0.96
tpcds_q94/datafusion:parquet 31155473 30482685 1.02
tpcds_q95/datafusion:parquet 89091851 89094956 1.00
tpcds_q96/datafusion:parquet 16805166 16073628 1.05
tpcds_q97/datafusion:parquet 40364065 39346790 1.03
tpcds_q98/datafusion:parquet 27238156 27319329 1.00
tpcds_q99/datafusion:parquet 34233611 35181476 0.97
duckdb / vortex-file-compressed / ns (1.026x ➖, 2↑ 10↓)
name PR 3062ebb (ns) base 39fde8c (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 28531795 27316354 1.04
tpcds_q02/duckdb:vortex-file-compressed 30977648 29120409 1.06
tpcds_q03/duckdb:vortex-file-compressed 23683123 23752987 1.00
tpcds_q04/duckdb:vortex-file-compressed 101308209 98396882 1.03
tpcds_q05/duckdb:vortex-file-compressed 41243526 38673137 1.07
tpcds_q06/duckdb:vortex-file-compressed 52790587 53694057 0.98
tpcds_q07/duckdb:vortex-file-compressed 34434964 35656555 0.97
tpcds_q08/duckdb:vortex-file-compressed 35510405 35015969 1.01
tpcds_q09/duckdb:vortex-file-compressed 18069549 16469092 1.10
tpcds_q10/duckdb:vortex-file-compressed 54545316 53472088 1.02
tpcds_q11/duckdb:vortex-file-compressed 80918620 74673730 1.08
tpcds_q12/duckdb:vortex-file-compressed 18604656 18861441 0.99
tpcds_q13/duckdb:vortex-file-compressed 41887407 39937685 1.05
tpcds_q14/duckdb:vortex-file-compressed 121036027 115455235 1.05
tpcds_q15/duckdb:vortex-file-compressed 35960338 34940844 1.03
tpcds_q16/duckdb:vortex-file-compressed 🚨 36695246 32490032 1.13
tpcds_q17/duckdb:vortex-file-compressed 55331234 58756257 0.94
tpcds_q18/duckdb:vortex-file-compressed 51896718 51141633 1.01
tpcds_q19/duckdb:vortex-file-compressed 43388086 41837786 1.04
tpcds_q20/duckdb:vortex-file-compressed 🚀 17842652 19973581 0.89
tpcds_q21/duckdb:vortex-file-compressed 22285800 22951976 0.97
tpcds_q22/duckdb:vortex-file-compressed 62774399 66414989 0.95
tpcds_q23/duckdb:vortex-file-compressed 82291977 82240212 1.00
tpcds_q24/duckdb:vortex-file-compressed 52327662 49763835 1.05
tpcds_q25/duckdb:vortex-file-compressed 51420872 52282237 0.98
tpcds_q26/duckdb:vortex-file-compressed 24128925 22109731 1.09
tpcds_q27/duckdb:vortex-file-compressed 33519589 33285052 1.01
tpcds_q28/duckdb:vortex-file-compressed 🚨 18475635 15593959 1.18
tpcds_q29/duckdb:vortex-file-compressed 56585499 56451421 1.00
tpcds_q30/duckdb:vortex-file-compressed 36746374 36272289 1.01
tpcds_q31/duckdb:vortex-file-compressed 37642322 34276757 1.10
tpcds_q32/duckdb:vortex-file-compressed 18977544 19920263 0.95
tpcds_q33/duckdb:vortex-file-compressed 33101393 34877067 0.95
tpcds_q34/duckdb:vortex-file-compressed 31238230 31086000 1.00
tpcds_q35/duckdb:vortex-file-compressed 86947664 88612229 0.98
tpcds_q36/duckdb:vortex-file-compressed 33513952 30804329 1.09
tpcds_q37/duckdb:vortex-file-compressed 27808047 26298485 1.06
tpcds_q38/duckdb:vortex-file-compressed 42463361 41886063 1.01
tpcds_q39/duckdb:vortex-file-compressed 37273726 35217730 1.06
tpcds_q40/duckdb:vortex-file-compressed 24717601 25067267 0.99
tpcds_q41/duckdb:vortex-file-compressed 🚨 20219260 14409891 1.40
tpcds_q42/duckdb:vortex-file-compressed 20908466 19334584 1.08
tpcds_q43/duckdb:vortex-file-compressed 🚨 23530738 21043457 1.12
tpcds_q44/duckdb:vortex-file-compressed 🚨 30340174 27302240 1.11
tpcds_q45/duckdb:vortex-file-compressed 39101398 36195379 1.08
tpcds_q46/duckdb:vortex-file-compressed 39977376 42852412 0.93
tpcds_q47/duckdb:vortex-file-compressed 61248632 56967680 1.08
tpcds_q48/duckdb:vortex-file-compressed 41159520 39230333 1.05
tpcds_q49/duckdb:vortex-file-compressed 44340623 48564636 0.91
tpcds_q50/duckdb:vortex-file-compressed 35317708 38315539 0.92
tpcds_q51/duckdb:vortex-file-compressed 108592584 111451135 0.97
tpcds_q52/duckdb:vortex-file-compressed 🚨 20886899 17856183 1.17
tpcds_q53/duckdb:vortex-file-compressed 🚨 31906389 28941195 1.10
tpcds_q54/duckdb:vortex-file-compressed 47272878 47668765 0.99
tpcds_q55/duckdb:vortex-file-compressed 17494349 17051100 1.03
tpcds_q56/duckdb:vortex-file-compressed 33846262 34004532 1.00
tpcds_q57/duckdb:vortex-file-compressed 46413085 42522951 1.09
tpcds_q58/duckdb:vortex-file-compressed 🚨 43841870 39832936 1.10
tpcds_q59/duckdb:vortex-file-compressed 41166922 40185332 1.02
tpcds_q60/duckdb:vortex-file-compressed 🚨 39797108 35380037 1.12
tpcds_q61/duckdb:vortex-file-compressed 41405235 39298837 1.05
tpcds_q62/duckdb:vortex-file-compressed 22292633 20352465 1.10
tpcds_q63/duckdb:vortex-file-compressed 🚨 29189280 26270298 1.11
tpcds_q64/duckdb:vortex-file-compressed 119922149 117194199 1.02
tpcds_q65/duckdb:vortex-file-compressed 28801013 27582850 1.04
tpcds_q66/duckdb:vortex-file-compressed 39091953 40054709 0.98
tpcds_q67/duckdb:vortex-file-compressed 131264186 135901537 0.97
tpcds_q68/duckdb:vortex-file-compressed 41224709 40780716 1.01
tpcds_q69/duckdb:vortex-file-compressed 60293410 59228744 1.02
tpcds_q70/duckdb:vortex-file-compressed 46168231 44506699 1.04
tpcds_q71/duckdb:vortex-file-compressed 25667672 25694828 1.00
tpcds_q72/duckdb:vortex-file-compressed 154599432 156024073 0.99
tpcds_q73/duckdb:vortex-file-compressed 32867220 32315819 1.02
tpcds_q74/duckdb:vortex-file-compressed 54431558 51691346 1.05
tpcds_q75/duckdb:vortex-file-compressed 60932626 58457483 1.04
tpcds_q76/duckdb:vortex-file-compressed 26970852 26595672 1.01
tpcds_q77/duckdb:vortex-file-compressed 31356708 33717859 0.93
tpcds_q78/duckdb:vortex-file-compressed 77777410 81143202 0.96
tpcds_q79/duckdb:vortex-file-compressed 33984600 34785041 0.98
tpcds_q80/duckdb:vortex-file-compressed 60765479 55923418 1.09
tpcds_q81/duckdb:vortex-file-compressed 43789176 43028286 1.02
tpcds_q82/duckdb:vortex-file-compressed 56092885 57144936 0.98
tpcds_q83/duckdb:vortex-file-compressed 42985293 44104096 0.97
tpcds_q84/duckdb:vortex-file-compressed 28879219 30049369 0.96
tpcds_q85/duckdb:vortex-file-compressed 58500612 56024745 1.04
tpcds_q86/duckdb:vortex-file-compressed 21084922 22426940 0.94
tpcds_q87/duckdb:vortex-file-compressed 50731964 48667186 1.04
tpcds_q88/duckdb:vortex-file-compressed 69346916 63061881 1.10
tpcds_q89/duckdb:vortex-file-compressed 🚀 27027507 30136602 0.90
tpcds_q90/duckdb:vortex-file-compressed 20661543 18868282 1.10
tpcds_q91/duckdb:vortex-file-compressed 34614181 34496753 1.00
tpcds_q92/duckdb:vortex-file-compressed 26032094 25058219 1.04
tpcds_q93/duckdb:vortex-file-compressed 30677085 29935556 1.02
tpcds_q94/duckdb:vortex-file-compressed 36139043 36769357 0.98
tpcds_q95/duckdb:vortex-file-compressed 154205694 150568113 1.02
tpcds_q96/duckdb:vortex-file-compressed 18536214 17901338 1.04
tpcds_q97/duckdb:vortex-file-compressed 46228939 44488818 1.04
tpcds_q98/duckdb:vortex-file-compressed 25783887 25614547 1.01
tpcds_q99/duckdb:vortex-file-compressed 25926754 27592839 0.94
duckdb / vortex-compact / ns (1.011x ➖, 2↑ 5↓)
name PR 3062ebb (ns) base 39fde8c (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 32180441 29726422 1.08
tpcds_q02/duckdb:vortex-compact 30858443 29445014 1.05
tpcds_q03/duckdb:vortex-compact 43899394 44664405 0.98
tpcds_q04/duckdb:vortex-compact 105337826 97800659 1.08
tpcds_q05/duckdb:vortex-compact 🚨 52905477 48013588 1.10
tpcds_q06/duckdb:vortex-compact 58670698 61509430 0.95
tpcds_q07/duckdb:vortex-compact 51582869 54302077 0.95
tpcds_q08/duckdb:vortex-compact 98952771 94791512 1.04
tpcds_q09/duckdb:vortex-compact 🚨 25028553 22406761 1.12
tpcds_q10/duckdb:vortex-compact 91166005 87197085 1.05
tpcds_q11/duckdb:vortex-compact 82458754 81973625 1.01
tpcds_q12/duckdb:vortex-compact 22963159 22964317 1.00
tpcds_q13/duckdb:vortex-compact 74227784 75623911 0.98
tpcds_q14/duckdb:vortex-compact 131329908 133355784 0.98
tpcds_q15/duckdb:vortex-compact 40904794 41531919 0.98
tpcds_q16/duckdb:vortex-compact 43279942 44101876 0.98
tpcds_q17/duckdb:vortex-compact 88047045 87090101 1.01
tpcds_q18/duckdb:vortex-compact 65574457 69352128 0.95
tpcds_q19/duckdb:vortex-compact 64534326 64630217 1.00
tpcds_q20/duckdb:vortex-compact 22251849 22227038 1.00
tpcds_q21/duckdb:vortex-compact 24763471 24703715 1.00
tpcds_q22/duckdb:vortex-compact 66689115 69617241 0.96
tpcds_q23/duckdb:vortex-compact 96569349 93883413 1.03
tpcds_q24/duckdb:vortex-compact 71119704 69764738 1.02
tpcds_q25/duckdb:vortex-compact 76896122 78401233 0.98
tpcds_q26/duckdb:vortex-compact 38272209 39086916 0.98
tpcds_q27/duckdb:vortex-compact 63386010 61463353 1.03
tpcds_q28/duckdb:vortex-compact 22634531 20715948 1.09
tpcds_q29/duckdb:vortex-compact 84322773 83757237 1.01
tpcds_q30/duckdb:vortex-compact 42338008 40166931 1.05
tpcds_q31/duckdb:vortex-compact 46140422 46813492 0.99
tpcds_q32/duckdb:vortex-compact 24196757 26208518 0.92
tpcds_q33/duckdb:vortex-compact 46902948 45400014 1.03
tpcds_q34/duckdb:vortex-compact 49192519 47833031 1.03
tpcds_q35/duckdb:vortex-compact 113929219 114657638 0.99
tpcds_q36/duckdb:vortex-compact 45005387 43778203 1.03
tpcds_q37/duckdb:vortex-compact 27549008 28092529 0.98
tpcds_q38/duckdb:vortex-compact 49681197 52300668 0.95
tpcds_q39/duckdb:vortex-compact 37548053 36538854 1.03
tpcds_q40/duckdb:vortex-compact 26304040 27217594 0.97
tpcds_q41/duckdb:vortex-compact 🚨 21191406 15584543 1.36
tpcds_q42/duckdb:vortex-compact 25689052 23620328 1.09
tpcds_q43/duckdb:vortex-compact 35223179 34615288 1.02
tpcds_q44/duckdb:vortex-compact 32789183 33000677 0.99
tpcds_q45/duckdb:vortex-compact 46396218 44494119 1.04
tpcds_q46/duckdb:vortex-compact 65211825 64588278 1.01
tpcds_q47/duckdb:vortex-compact 70712281 68004218 1.04
tpcds_q48/duckdb:vortex-compact 66259486 69498913 0.95
tpcds_q49/duckdb:vortex-compact 56708775 56672770 1.00
tpcds_q50/duckdb:vortex-compact 56603838 55864423 1.01
tpcds_q51/duckdb:vortex-compact 🚀 107059990 141571250 0.76
tpcds_q52/duckdb:vortex-compact 24244848 23848684 1.02
tpcds_q53/duckdb:vortex-compact 43598174 42501280 1.03
tpcds_q54/duckdb:vortex-compact 57626868 54045283 1.07
tpcds_q55/duckdb:vortex-compact 26019290 25391578 1.02
tpcds_q56/duckdb:vortex-compact 45132038 47539270 0.95
tpcds_q57/duckdb:vortex-compact 49437826 49289534 1.00
tpcds_q58/duckdb:vortex-compact 48067556 47386362 1.01
tpcds_q59/duckdb:vortex-compact 48899827 49019556 1.00
tpcds_q60/duckdb:vortex-compact 🚨 51347412 46327854 1.11
tpcds_q61/duckdb:vortex-compact 64921585 62670760 1.04
tpcds_q62/duckdb:vortex-compact 23816117 22246788 1.07
tpcds_q63/duckdb:vortex-compact 41174509 42461846 0.97
tpcds_q64/duckdb:vortex-compact 165836871 163114765 1.02
tpcds_q65/duckdb:vortex-compact 37929219 37290359 1.02
tpcds_q66/duckdb:vortex-compact 48654540 46640896 1.04
tpcds_q67/duckdb:vortex-compact 148072856 142512195 1.04
tpcds_q68/duckdb:vortex-compact 64313386 62430057 1.03
tpcds_q69/duckdb:vortex-compact 90738310 91327202 0.99
tpcds_q70/duckdb:vortex-compact 65058913 63624183 1.02
tpcds_q71/duckdb:vortex-compact 37965498 37729175 1.01
tpcds_q72/duckdb:vortex-compact 171866676 166155802 1.03
tpcds_q73/duckdb:vortex-compact 46457354 47973301 0.97
tpcds_q74/duckdb:vortex-compact 60082211 58066790 1.03
tpcds_q75/duckdb:vortex-compact 76045122 73341007 1.04
tpcds_q76/duckdb:vortex-compact 30915126 30374845 1.02
tpcds_q77/duckdb:vortex-compact 46879466 44303468 1.06
tpcds_q78/duckdb:vortex-compact 89250112 92244682 0.97
tpcds_q79/duckdb:vortex-compact 76519117 75434204 1.01
tpcds_q80/duckdb:vortex-compact 🚀 71629710 80282308 0.89
tpcds_q81/duckdb:vortex-compact 44454204 44639919 1.00
tpcds_q82/duckdb:vortex-compact 60514909 60565849 1.00
tpcds_q83/duckdb:vortex-compact 49693703 52114156 0.95
tpcds_q84/duckdb:vortex-compact 🚨 34883707 28358690 1.23
tpcds_q85/duckdb:vortex-compact 78080149 80630455 0.97
tpcds_q86/duckdb:vortex-compact 21930912 24306457 0.90
tpcds_q87/duckdb:vortex-compact 58576377 57800896 1.01
tpcds_q88/duckdb:vortex-compact 115887798 113091792 1.02
tpcds_q89/duckdb:vortex-compact 41447477 42005529 0.99
tpcds_q90/duckdb:vortex-compact 22443399 20407094 1.10
tpcds_q91/duckdb:vortex-compact 74637750 70844355 1.05
tpcds_q92/duckdb:vortex-compact 43088334 41262694 1.04
tpcds_q93/duckdb:vortex-compact 35638194 36196088 0.98
tpcds_q94/duckdb:vortex-compact 45153858 41529287 1.09
tpcds_q95/duckdb:vortex-compact 162041962 162116186 1.00
tpcds_q96/duckdb:vortex-compact 37492847 40707467 0.92
tpcds_q97/duckdb:vortex-compact 48982377 53117715 0.92
tpcds_q98/duckdb:vortex-compact 32783400 32768969 1.00
tpcds_q99/duckdb:vortex-compact 31156009 30254217 1.03
duckdb / parquet / ns (1.003x ➖, 4↑ 4↓)
name PR 3062ebb (ns) base 39fde8c (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 32068801 31335032 1.02
tpcds_q02/duckdb:parquet 🚨 24432677 21734561 1.12
tpcds_q03/duckdb:parquet 12405536 12391500 1.00
tpcds_q04/duckdb:parquet 198856077 197182240 1.01
tpcds_q05/duckdb:parquet 32886462 32570167 1.01
tpcds_q06/duckdb:parquet 35662464 35097829 1.02
tpcds_q07/duckdb:parquet 23134618 22077571 1.05
tpcds_q08/duckdb:parquet 32776741 32410878 1.01
tpcds_q09/duckdb:parquet 30425213 30528012 1.00
tpcds_q10/duckdb:parquet 42338122 41214776 1.03
tpcds_q11/duckdb:parquet 102312962 101842266 1.00
tpcds_q12/duckdb:parquet 17525408 17796593 0.98
tpcds_q13/duckdb:parquet 🚀 33784270 39416453 0.86
tpcds_q14/duckdb:parquet 103589104 102270545 1.01
tpcds_q15/duckdb:parquet 35019942 35551455 0.99
tpcds_q16/duckdb:parquet 27358927 27293422 1.00
tpcds_q17/duckdb:parquet 45359023 44981318 1.01
tpcds_q18/duckdb:parquet 56485021 54984626 1.03
tpcds_q19/duckdb:parquet 34344482 33752543 1.02
tpcds_q20/duckdb:parquet 19029726 19344926 0.98
tpcds_q21/duckdb:parquet 13980137 14109103 0.99
tpcds_q22/duckdb:parquet 63353215 59203012 1.07
tpcds_q23/duckdb:parquet 🚨 71575888 64672746 1.11
tpcds_q24/duckdb:parquet 48092397 48325358 1.00
tpcds_q25/duckdb:parquet 41623659 41996334 0.99
tpcds_q26/duckdb:parquet 43634074 43424992 1.00
tpcds_q27/duckdb:parquet 53511820 54874628 0.98
tpcds_q28/duckdb:parquet 28938641 29680993 0.97
tpcds_q29/duckdb:parquet 42914190 43125281 1.00
tpcds_q30/duckdb:parquet 43438412 45059506 0.96
tpcds_q31/duckdb:parquet 28565207 28155398 1.01
tpcds_q32/duckdb:parquet 14675279 15100246 0.97
tpcds_q33/duckdb:parquet 23086645 23579228 0.98
tpcds_q34/duckdb:parquet 21814141 21928536 0.99
tpcds_q35/duckdb:parquet 67280033 67699512 0.99
tpcds_q36/duckdb:parquet 22153158 22143258 1.00
tpcds_q37/duckdb:parquet 18155904 17462125 1.04
tpcds_q38/duckdb:parquet 40447414 41411042 0.98
tpcds_q39/duckdb:parquet 37524808 38190967 0.98
tpcds_q40/duckdb:parquet 22964589 22857869 1.00
tpcds_q41/duckdb:parquet 10928216 10679970 1.02
tpcds_q42/duckdb:parquet 🚨 13559299 11583914 1.17
tpcds_q43/duckdb:parquet 18987849 18914314 1.00
tpcds_q44/duckdb:parquet 24439710 24451190 1.00
tpcds_q45/duckdb:parquet 32718724 33542540 0.98
tpcds_q46/duckdb:parquet 50252102 49537223 1.01
tpcds_q47/duckdb:parquet 48554357 47377603 1.02
tpcds_q48/duckdb:parquet 29526167 30783826 0.96
tpcds_q49/duckdb:parquet 28170073 28663843 0.98
tpcds_q50/duckdb:parquet 🚨 29727236 24459330 1.22
tpcds_q51/duckdb:parquet 101217958 94810760 1.07
tpcds_q52/duckdb:parquet 🚀 11993480 13415984 0.89
tpcds_q53/duckdb:parquet 🚀 15971681 18104596 0.88
tpcds_q54/duckdb:parquet 30117201 31062306 0.97
tpcds_q55/duckdb:parquet 11811012 12031023 0.98
tpcds_q56/duckdb:parquet 25825558 24909714 1.04
tpcds_q57/duckdb:parquet 42393838 42573586 1.00
tpcds_q58/duckdb:parquet 28058448 28909466 0.97
tpcds_q59/duckdb:parquet 29562678 29783694 0.99
tpcds_q60/duckdb:parquet 26609994 25877898 1.03
tpcds_q61/duckdb:parquet 33967837 31596457 1.08
tpcds_q62/duckdb:parquet 14322442 14231943 1.01
tpcds_q63/duckdb:parquet 17414304 17185492 1.01
tpcds_q64/duckdb:parquet 81892705 83931472 0.98
tpcds_q65/duckdb:parquet 22847287 21602898 1.06
tpcds_q66/duckdb:parquet 34651016 34741052 1.00
tpcds_q67/duckdb:parquet 129867453 124354856 1.04
tpcds_q68/duckdb:parquet 39556681 39602879 1.00
tpcds_q69/duckdb:parquet 42582588 42528822 1.00
tpcds_q70/duckdb:parquet 🚀 27473633 30618083 0.90
tpcds_q71/duckdb:parquet 21207578 21006510 1.01
tpcds_q72/duckdb:parquet 120681890 121319348 0.99
tpcds_q73/duckdb:parquet 18142466 18174666 1.00
tpcds_q74/duckdb:parquet 145962407 146049662 1.00
tpcds_q75/duckdb:parquet 60533014 60341903 1.00
tpcds_q76/duckdb:parquet 19638305 18877853 1.04
tpcds_q77/duckdb:parquet 24636639 25428462 0.97
tpcds_q78/duckdb:parquet 78108782 77698453 1.01
tpcds_q79/duckdb:parquet 28697820 27784255 1.03
tpcds_q80/duckdb:parquet 46259419 47255391 0.98
tpcds_q81/duckdb:parquet 41017194 41046983 1.00
tpcds_q82/duckdb:parquet 18489716 19877688 0.93
tpcds_q83/duckdb:parquet 21890032 22198998 0.99
tpcds_q84/duckdb:parquet 24385412 23830350 1.02
tpcds_q85/duckdb:parquet 47869911 47955274 1.00
tpcds_q86/duckdb:parquet 15191065 14652392 1.04
tpcds_q87/duckdb:parquet 42993910 43127593 1.00
tpcds_q88/duckdb:parquet 43192073 42930240 1.01
tpcds_q89/duckdb:parquet 17926943 17686325 1.01
tpcds_q90/duckdb:parquet 9716047 9598008 1.01
tpcds_q91/duckdb:parquet 27493174 27134928 1.01
tpcds_q92/duckdb:parquet 15577451 15525269 1.00
tpcds_q93/duckdb:parquet 31369391 30636240 1.02
tpcds_q94/duckdb:parquet 21759063 21715168 1.00
tpcds_q95/duckdb:parquet 137239096 137898280 1.00
tpcds_q96/duckdb:parquet 10111853 11078578 0.91
tpcds_q97/duckdb:parquet 39554523 39724793 1.00
tpcds_q98/duckdb:parquet 21454492 21198139 1.01
tpcds_q99/duckdb:parquet 23908616 23574530 1.01

No file size changes detected.

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Vortex (geomean): 0.978x ➖


datafusion / vortex-file-compressed / ns (0.978x ➖, 1↑ 0↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 128440241 132948233 0.97
polarsignals_q01/datafusion:vortex-file-compressed 163561968 162425236 1.01
polarsignals_q02/datafusion:vortex-file-compressed 21864697 20477308 1.07
polarsignals_q03/datafusion:vortex-file-compressed 165633462 163853248 1.01
polarsignals_q04/datafusion:vortex-file-compressed 10690456 11449116 0.93
polarsignals_q05/datafusion:vortex-file-compressed 13760227 13292317 1.04
polarsignals_q06/datafusion:vortex-file-compressed 22012967 23705284 0.93
polarsignals_q07/datafusion:vortex-file-compressed 12054904 11875896 1.02
polarsignals_q08/datafusion:vortex-file-compressed 275772355 275495847 1.00
polarsignals_q09/datafusion:vortex-file-compressed 🚀 11104631 13336991 0.83

File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 685.81 MB 685.83 MB +21.34 KB +0.0%

Totals:

  • vortex-file-compressed: 685.81 MB → 685.83 MB (+0.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (-0.8%, low confidence)
Vortex (geomean): 0.997x ➖
Parquet (geomean): 1.000x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-compact / ns (1.000x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
appian_q01/datafusion:vortex-compact 101438007 100929497 1.01
appian_q02/datafusion:vortex-compact 472066625 467483223 1.01
appian_q03/datafusion:vortex-compact 285341131 278467728 1.02
appian_q04/datafusion:vortex-compact 13560619741 13536582650 1.00
appian_q05/datafusion:vortex-compact 224569432 231269596 0.97
appian_q06/datafusion:vortex-compact 274837614 269702676 1.02
appian_q07/datafusion:vortex-compact 356051615 357744003 1.00
appian_q08/datafusion:vortex-compact 1398393973 1436085341 0.97
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
appian_q01/datafusion:parquet 133382301 134525462 0.99
appian_q02/datafusion:parquet 593652397 598124212 0.99
appian_q03/datafusion:parquet 302596652 307741719 0.98
appian_q04/datafusion:parquet 13708403379 13672457744 1.00
appian_q05/datafusion:parquet 311455413 308081289 1.01
appian_q06/datafusion:parquet 309263004 303474770 1.02
appian_q07/datafusion:parquet 433318420 437169309 0.99
appian_q08/datafusion:parquet 1537955176 1541816819 1.00
duckdb / vortex-compact / ns (0.994x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
appian_q01/duckdb:vortex-compact 149098696 158078743 0.94
appian_q02/duckdb:vortex-compact 410879345 402447768 1.02
appian_q03/duckdb:vortex-compact 261942317 261110563 1.00
appian_q04/duckdb:vortex-compact 1599934253 1600179221 1.00
appian_q05/duckdb:vortex-compact 249639700 251784371 0.99
appian_q06/duckdb:vortex-compact 1003674250 1027059807 0.98
appian_q07/duckdb:vortex-compact 293219434 288161889 1.02
appian_q08/duckdb:vortex-compact 922408179 919489337 1.00
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
appian_q01/duckdb:parquet 159877484 157362049 1.02
appian_q02/duckdb:parquet 359657492 355216318 1.01
appian_q03/duckdb:parquet 218129948 220961664 0.99
appian_q04/duckdb:parquet 1487234430 1482135663 1.00
appian_q05/duckdb:parquet 242515348 247700098 0.98
appian_q06/duckdb:parquet 983053979 956188968 1.03
appian_q07/duckdb:parquet 265987183 268002731 0.99
appian_q08/duckdb:parquet 786144823 786076827 1.00

File Size Changes (10 files changed, -63.8% overall, 0↑ 10↓)
File Scale Format Base HEAD Change %
addressview.vortex 1.0 vortex-file-compressed 34.61 MB 0 B 34.61 MB -100.0%
categoryview.vortex 1.0 vortex-file-compressed 19.91 KB 0 B 19.91 KB -100.0%
creditcardview.vortex 1.0 vortex-file-compressed 59.15 MB 0 B 59.15 MB -100.0%
customerview.vortex 1.0 vortex-file-compressed 19.98 MB 0 B 19.98 MB -100.0%
duckdb.db 1.0 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
orderitemnovelty_update.vortex 1.0 vortex-file-compressed 11.95 KB 0 B 11.95 KB -100.0%
orderitemview.vortex 1.0 vortex-file-compressed 265.21 MB 0 B 265.21 MB -100.0%
orderview.vortex 1.0 vortex-file-compressed 78.51 MB 0 B 78.51 MB -100.0%
productview.vortex 1.0 vortex-file-compressed 19.78 KB 0 B 19.78 KB -100.0%
taxrecordview.vortex 1.0 vortex-file-compressed 21.91 MB 0 B 21.91 MB -100.0%

Totals:

  • vortex-compact: 271.91 MB → 271.91 MB (0.0%)
  • vortex-file-compressed: 479.69 MB → 0 B (-100.0%)

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): 1.000x ➖
Parquet (geomean): 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

duckdb / vortex-file-compressed / ns (1.022x ➖, 0↑ 1↓)
name PR 3062ebb (ns) base 39fde8c (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 🚨 15470223 13962480 1.11
statpopgen_q01/duckdb:vortex-file-compressed 12944630 13060251 0.99
statpopgen_q02/duckdb:vortex-file-compressed 593724169 573764689 1.03
statpopgen_q03/duckdb:vortex-file-compressed 1318158351 1211094966 1.09
statpopgen_q04/duckdb:vortex-file-compressed 1325240498 1228778223 1.08
statpopgen_q05/duckdb:vortex-file-compressed 663199568 623241260 1.06
statpopgen_q06/duckdb:vortex-file-compressed 2233431401 2377725394 0.94
statpopgen_q07/duckdb:vortex-file-compressed 240544832 238480082 1.01
statpopgen_q08/duckdb:vortex-file-compressed 273865841 274282680 1.00
statpopgen_q09/duckdb:vortex-file-compressed 1024668685 1010033042 1.01
statpopgen_q10/duckdb:vortex-file-compressed 2903128876 3119561988 0.93
duckdb / vortex-compact / ns (0.979x ➖, 1↑ 1↓)
name PR 3062ebb (ns) base 39fde8c (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 15322163 14410415 1.06
statpopgen_q01/duckdb:vortex-compact 16599479 16219965 1.02
statpopgen_q02/duckdb:vortex-compact 627815716 695805834 0.90
statpopgen_q03/duckdb:vortex-compact 1359997792 1389897523 0.98
statpopgen_q04/duckdb:vortex-compact 1320966956 1372204077 0.96
statpopgen_q05/duckdb:vortex-compact 🚨 810611755 647038019 1.25
statpopgen_q06/duckdb:vortex-compact 1761826830 1793638012 0.98
statpopgen_q07/duckdb:vortex-compact 1068053884 1060090366 1.01
statpopgen_q08/duckdb:vortex-compact 1136685621 1091255248 1.04
statpopgen_q09/duckdb:vortex-compact 1041319201 1140365534 0.91
statpopgen_q10/duckdb:vortex-compact 🚀 3086753231 4268908664 0.72
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base 39fde8c (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 376597045 377651907 1.00
statpopgen_q01/duckdb:parquet 468223548 467063020 1.00
statpopgen_q02/duckdb:parquet 775496514 774476074 1.00
statpopgen_q03/duckdb:parquet 1064417887 1056532033 1.01
statpopgen_q04/duckdb:parquet 1050926946 1045821690 1.00
statpopgen_q05/duckdb:parquet 768292009 764109093 1.01
statpopgen_q06/duckdb:parquet 1010716187 1017000103 0.99
statpopgen_q07/duckdb:parquet 940205152 957539561 0.98
statpopgen_q08/duckdb:parquet 969101014 962896188 1.01
statpopgen_q09/duckdb:parquet 999126158 996796669 1.00
statpopgen_q10/duckdb:parquet 1665440090 1647747940 1.01

No file size changes detected.

`ZonedReader::pruning_evaluation` expanded the cached zone-level pruning
mask into a row-aligned bit buffer for every split, then intersected it
with the incoming mask. That cost a `Vec` of zone lengths (built eagerly,
before the future was polled), a `BitBufferMut` of the full split length,
a popcount over it, and a bitand, on every split of every scan.

For most splits the zones covering that split are uniform: either none
are pruned or all of them are. Both collapse to a constant stats mask, so
counting the covered zone bits first - a handful of bit reads via
`BitBuffer::count_range` - lets us skip the expansion entirely:

- no covered zone pruned: the stats mask is all-true, so forward the
  incoming mask unchanged,
- every covered zone pruned: return `Mask::new_false` directly,
- otherwise: fall through to the existing expansion.

The zone-length computation now lives on the non-uniform path, so uniform
splits allocate nothing. Results and masks are unchanged.

The equivalence is exact, not just bit-equal. `Mask::from_buffer`
canonicalises an all-ones buffer to `AllTrue` and an all-zeros buffer to
`AllFalse`, and owned-left `bitand` short circuits on both
(`(_, AllOr::All) => self` and `(_, AllOr::None) => new_false`). So the
old code already returned the incoming mask unchanged in the no-prune
case, after an allocation and two O(n) passes to rediscover that. The new
fast paths return the same `Mask` variant, not merely the same bits. No
path in this change does more work than before; the only addition is a
`count_range` over the covering zones on the non-uniform path.

This is a simplification, not a demonstrated speedup. Two full benchmark
sweeps were run over the same commit. Every suite returned "No clear
signal", and four of the six suites common to both sweeps flipped sign:
statpopgen -6.0% then +1.8%, clickbench-sorted -2.8% then +1.4%, tpcds
-1.4% then +0.7%, polarsignals +1.7% then -2.0%. The apparent statpopgen
win came from an anomalously slow baseline: q10 measured 4.26s base /
2.94s HEAD in the first sweep and 2.88s base / 3.12s HEAD in the second,
so HEAD was stable and the base was not. A tight Parquet control does not
rule this out - it bounds host drift, not per-path measurement variance.

What holds up is the absence of a regression. The lowest-noise suites all
read zero: random-access -0.1% (controls 0.98-1.04), appian +0.2% (all
rows 0.98-1.02), string encoding +0.1% (sizes byte-identical), tpch sf=10
-0.3% (controls 0.96-1.03). CodSpeed reports no change across 1934
benchmarks. No suite in either sweep showed a credible regression.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
joseph-isaacs force-pushed the claude/layoutreader-v1-scan-perf-0l1nci branch from cad24dc to 3062ebb Compare August 7, 2026 14:34
@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.1%
Engines: DataFusion No clear signal (+8.8%, environment too noisy confidence) · DuckDB No clear signal (-2.4%, low confidence)
Vortex (geomean): 1.016x ➖
Parquet (geomean): 0.986x ➖
Shifts: Parquet (control) -1.4% · Median polish -1.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (1.031x ➖, 1↑ 2↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 242988852 264418075 0.92
tpch_q02/datafusion:vortex-file-compressed 447393994 443056120 1.01
tpch_q03/datafusion:vortex-file-compressed 345562499 389483094 0.89
tpch_q04/datafusion:vortex-file-compressed 205716526 180058041 1.14
tpch_q05/datafusion:vortex-file-compressed 🚨 500593919 360564131 1.39
tpch_q06/datafusion:vortex-file-compressed 296542523 270205165 1.10
tpch_q07/datafusion:vortex-file-compressed 432290187 371282219 1.16
tpch_q08/datafusion:vortex-file-compressed 626943724 519702983 1.21
tpch_q09/datafusion:vortex-file-compressed 366986511 379439257 0.97
tpch_q10/datafusion:vortex-file-compressed 384625993 393464958 0.98
tpch_q11/datafusion:vortex-file-compressed 317540086 337911148 0.94
tpch_q12/datafusion:vortex-file-compressed 442568734 344035630 1.29
tpch_q13/datafusion:vortex-file-compressed 127475715 140298065 0.91
tpch_q14/datafusion:vortex-file-compressed 200652082 201428706 1.00
tpch_q15/datafusion:vortex-file-compressed 389788912 312751000 1.25
tpch_q16/datafusion:vortex-file-compressed 🚀 211215607 312594347 0.68
tpch_q17/datafusion:vortex-file-compressed 386244027 418804621 0.92
tpch_q18/datafusion:vortex-file-compressed 311927870 266183075 1.17
tpch_q19/datafusion:vortex-file-compressed 🚨 571518498 435745126 1.31
tpch_q20/datafusion:vortex-file-compressed 429873057 411307236 1.05
tpch_q21/datafusion:vortex-file-compressed 479944749 527373333 0.91
tpch_q22/datafusion:vortex-file-compressed 161184924 193217017 0.83
datafusion / vortex-compact / ns (1.105x ➖, 1↑ 3↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 249260003 257449282 0.97
tpch_q02/datafusion:vortex-compact 411601064 413251610 1.00
tpch_q03/datafusion:vortex-compact 344479173 367532764 0.94
tpch_q04/datafusion:vortex-compact 182859314 160996227 1.14
tpch_q05/datafusion:vortex-compact 480596154 396607958 1.21
tpch_q06/datafusion:vortex-compact 🚨 435645920 264092279 1.65
tpch_q07/datafusion:vortex-compact 🚨 742439004 451879119 1.64
tpch_q08/datafusion:vortex-compact 584755244 492689923 1.19
tpch_q09/datafusion:vortex-compact 433453378 341140738 1.27
tpch_q10/datafusion:vortex-compact 430057697 363787338 1.18
tpch_q11/datafusion:vortex-compact 338661945 312670984 1.08
tpch_q12/datafusion:vortex-compact 377774706 318502852 1.19
tpch_q13/datafusion:vortex-compact 121436744 115200629 1.05
tpch_q14/datafusion:vortex-compact 207256894 178938805 1.16
tpch_q15/datafusion:vortex-compact 362690952 303492513 1.20
tpch_q16/datafusion:vortex-compact 234108456 199614300 1.17
tpch_q17/datafusion:vortex-compact 300722712 412916229 0.73
tpch_q18/datafusion:vortex-compact 🚀 242467980 380182197 0.64
tpch_q19/datafusion:vortex-compact 489044029 531439193 0.92
tpch_q20/datafusion:vortex-compact 355484699 334432403 1.06
tpch_q21/datafusion:vortex-compact 461822402 449430628 1.03
tpch_q22/datafusion:vortex-compact 🚨 199582417 137657700 1.45
datafusion / parquet / ns (0.981x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 240208570 215313555 1.12
tpch_q02/datafusion:parquet 291332766 280663401 1.04
tpch_q03/datafusion:parquet 294535822 309659064 0.95
tpch_q04/datafusion:parquet 159340471 159079152 1.00
tpch_q05/datafusion:parquet 376091419 378564204 0.99
tpch_q06/datafusion:parquet 151524488 152510389 0.99
tpch_q07/datafusion:parquet 398317789 394260282 1.01
tpch_q08/datafusion:parquet 476943723 542919653 0.88
tpch_q09/datafusion:parquet 504414920 481937545 1.05
tpch_q10/datafusion:parquet 411137908 445040219 0.92
tpch_q11/datafusion:parquet 278832094 295939115 0.94
tpch_q12/datafusion:parquet 221604646 236290069 0.94
tpch_q13/datafusion:parquet 459521306 459242235 1.00
tpch_q14/datafusion:parquet 172464357 175624572 0.98
tpch_q15/datafusion:parquet 285955971 321134128 0.89
tpch_q16/datafusion:parquet 129366115 131915531 0.98
tpch_q17/datafusion:parquet 312516964 324186933 0.96
tpch_q18/datafusion:parquet 458518003 458299488 1.00
tpch_q19/datafusion:parquet 197439779 212769184 0.93
tpch_q20/datafusion:parquet 319111931 324238832 0.98
tpch_q21/datafusion:parquet 480693926 457774721 1.05
tpch_q22/datafusion:parquet 197876289 197768132 1.00
duckdb / vortex-file-compressed / ns (1.021x ➖, 0↑ 1↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 271406681 262883462 1.03
tpch_q02/duckdb:vortex-file-compressed 610151549 680655321 0.90
tpch_q03/duckdb:vortex-file-compressed 568272119 449134898 1.27
tpch_q04/duckdb:vortex-file-compressed 300788439 307331438 0.98
tpch_q05/duckdb:vortex-file-compressed 650042577 513278325 1.27
tpch_q06/duckdb:vortex-file-compressed 322318623 288020920 1.12
tpch_q07/duckdb:vortex-file-compressed 647560606 652655209 0.99
tpch_q08/duckdb:vortex-file-compressed 738700250 781183489 0.95
tpch_q09/duckdb:vortex-file-compressed 599467564 653508345 0.92
tpch_q10/duckdb:vortex-file-compressed 526735454 499335986 1.05
tpch_q11/duckdb:vortex-file-compressed 266018832 268167008 0.99
tpch_q12/duckdb:vortex-file-compressed 479465533 487933754 0.98
tpch_q13/duckdb:vortex-file-compressed 311890122 322084390 0.97
tpch_q14/duckdb:vortex-file-compressed 266769858 273106185 0.98
tpch_q15/duckdb:vortex-file-compressed 180029533 188728684 0.95
tpch_q16/duckdb:vortex-file-compressed 232267452 283624545 0.82
tpch_q17/duckdb:vortex-file-compressed 468226100 481082819 0.97
tpch_q18/duckdb:vortex-file-compressed 378588060 405523240 0.93
tpch_q19/duckdb:vortex-file-compressed 367725784 343385888 1.07
tpch_q20/duckdb:vortex-file-compressed 518857636 507823329 1.02
tpch_q21/duckdb:vortex-file-compressed 869369153 753212513 1.15
tpch_q22/duckdb:vortex-file-compressed 🚨 207281273 159433737 1.30
duckdb / vortex-compact / ns (0.916x ➖, 1↑ 0↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 253986654 245408818 1.03
tpch_q02/duckdb:vortex-compact 620730479 637622814 0.97
tpch_q03/duckdb:vortex-compact 465366102 476761949 0.98
tpch_q04/duckdb:vortex-compact 272510221 301825114 0.90
tpch_q05/duckdb:vortex-compact 582907708 631435022 0.92
tpch_q06/duckdb:vortex-compact 300522034 300469542 1.00
tpch_q07/duckdb:vortex-compact 570618883 576461091 0.99
tpch_q08/duckdb:vortex-compact 674728059 803958475 0.84
tpch_q09/duckdb:vortex-compact 639434611 667835144 0.96
tpch_q10/duckdb:vortex-compact 491514592 531978910 0.92
tpch_q11/duckdb:vortex-compact 268253566 261651277 1.03
tpch_q12/duckdb:vortex-compact 🚀 410368876 777776692 0.53
tpch_q13/duckdb:vortex-compact 258179699 357334014 0.72
tpch_q14/duckdb:vortex-compact 248026499 339619325 0.73
tpch_q15/duckdb:vortex-compact 189118099 205037796 0.92
tpch_q16/duckdb:vortex-compact 222054149 225685231 0.98
tpch_q17/duckdb:vortex-compact 441636529 446545298 0.99
tpch_q18/duckdb:vortex-compact 349163837 380109869 0.92
tpch_q19/duckdb:vortex-compact 379724525 403340862 0.94
tpch_q20/duckdb:vortex-compact 511312030 526916316 0.97
tpch_q21/duckdb:vortex-compact 825151714 734391441 1.12
tpch_q22/duckdb:vortex-compact 152720625 154264449 0.99
duckdb / parquet / ns (0.991x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 338718667 341910133 0.99
tpch_q02/duckdb:parquet 705690042 687868449 1.03
tpch_q03/duckdb:parquet 881496459 902712543 0.98
tpch_q04/duckdb:parquet 513869459 520596718 0.99
tpch_q05/duckdb:parquet 1042213669 1043568856 1.00
tpch_q06/duckdb:parquet 315057357 353668889 0.89
tpch_q07/duckdb:parquet 938360684 969369649 0.97
tpch_q08/duckdb:parquet 1198620466 1147418085 1.04
tpch_q09/duckdb:parquet 1106427510 1133327694 0.98
tpch_q10/duckdb:parquet 1046390506 1026985491 1.02
tpch_q11/duckdb:parquet 477276036 505446484 0.94
tpch_q12/duckdb:parquet 613794961 584446463 1.05
tpch_q13/duckdb:parquet 878482345 864166557 1.02
tpch_q14/duckdb:parquet 525380900 560681485 0.94
tpch_q15/duckdb:parquet 398287750 430279661 0.93
tpch_q16/duckdb:parquet 540991772 553958934 0.98
tpch_q17/duckdb:parquet 502442275 514293066 0.98
tpch_q18/duckdb:parquet 708777281 671491699 1.06
tpch_q19/duckdb:parquet 665605486 608229317 1.09
tpch_q20/duckdb:parquet 913070441 907978695 1.01
tpch_q21/duckdb:parquet 800484153 803354459 1.00
tpch_q22/duckdb:parquet 453431480 470471440 0.96

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-0.7%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): 0.994x ➖
Parquet (geomean): 1.000x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (0.990x ➖, 1↑ 1↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 2033344 2074978 0.98
clickbench_q01/datafusion:vortex-file-compressed 11193341 11028003 1.01
clickbench_q02/datafusion:vortex-file-compressed 22873473 22298435 1.03
clickbench_q03/datafusion:vortex-file-compressed 25678766 25565013 1.00
clickbench_q04/datafusion:vortex-file-compressed 160731321 161754924 0.99
clickbench_q05/datafusion:vortex-file-compressed 213853271 213794766 1.00
clickbench_q06/datafusion:vortex-file-compressed 2163676 2032971 1.06
clickbench_q07/datafusion:vortex-file-compressed 14764279 14497811 1.02
clickbench_q08/datafusion:vortex-file-compressed 218459058 216831182 1.01
clickbench_q09/datafusion:vortex-file-compressed 341672831 356678021 0.96
clickbench_q10/datafusion:vortex-file-compressed 51273138 51514958 1.00
clickbench_q11/datafusion:vortex-file-compressed 57957893 58803461 0.99
clickbench_q12/datafusion:vortex-file-compressed 195338086 195974470 1.00
clickbench_q13/datafusion:vortex-file-compressed 341926736 343125969 1.00
clickbench_q14/datafusion:vortex-file-compressed 202549076 195389690 1.04
clickbench_q15/datafusion:vortex-file-compressed 203462983 198983788 1.02
clickbench_q16/datafusion:vortex-file-compressed 463051677 481578125 0.96
clickbench_q17/datafusion:vortex-file-compressed 501051797 473501054 1.06
clickbench_q18/datafusion:vortex-file-compressed 921255416 931567020 0.99
clickbench_q19/datafusion:vortex-file-compressed 🚀 17961137 35294170 0.51
clickbench_q20/datafusion:vortex-file-compressed 200364647 196448717 1.02
clickbench_q21/datafusion:vortex-file-compressed 263115595 271354771 0.97
clickbench_q22/datafusion:vortex-file-compressed 344931219 344759664 1.00
clickbench_q23/datafusion:vortex-file-compressed 447623749 430212138 1.04
clickbench_q24/datafusion:vortex-file-compressed 36186589 37784915 0.96
clickbench_q25/datafusion:vortex-file-compressed 🚨 54248246 47064794 1.15
clickbench_q26/datafusion:vortex-file-compressed 39102345 39251908 1.00
clickbench_q27/datafusion:vortex-file-compressed 283511960 279990897 1.01
clickbench_q28/datafusion:vortex-file-compressed 1457259803 1494062664 0.98
clickbench_q29/datafusion:vortex-file-compressed 50256864 52638941 0.95
clickbench_q30/datafusion:vortex-file-compressed 162952944 174291225 0.93
clickbench_q31/datafusion:vortex-file-compressed 193444694 193441040 1.00
clickbench_q32/datafusion:vortex-file-compressed 824172237 829159743 0.99
clickbench_q33/datafusion:vortex-file-compressed 1054246074 1032993318 1.02
clickbench_q34/datafusion:vortex-file-compressed 1067837144 1021148047 1.05
clickbench_q35/datafusion:vortex-file-compressed 165087388 176943776 0.93
clickbench_q36/datafusion:vortex-file-compressed 61071358 58250368 1.05
clickbench_q37/datafusion:vortex-file-compressed 28894166 28043332 1.03
clickbench_q38/datafusion:vortex-file-compressed 16021585 16222972 0.99
clickbench_q39/datafusion:vortex-file-compressed 133477327 136103077 0.98
clickbench_q40/datafusion:vortex-file-compressed 12863590 12665987 1.02
clickbench_q41/datafusion:vortex-file-compressed 12866670 12147360 1.06
clickbench_q42/datafusion:vortex-file-compressed 13683626 13361568 1.02
datafusion / vortex-compact / ns (1.000x ➖, 1↑ 0↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-compact 2094807 2057428 1.02
clickbench_q01/datafusion:vortex-compact 14284183 14202736 1.01
clickbench_q02/datafusion:vortex-compact 52410060 52896296 0.99
clickbench_q03/datafusion:vortex-compact 32226985 32227012 1.00
clickbench_q04/datafusion:vortex-compact 162150449 164561255 0.99
clickbench_q05/datafusion:vortex-compact 234695350 245360317 0.96
clickbench_q06/datafusion:vortex-compact 1971117 1960268 1.01
clickbench_q07/datafusion:vortex-compact 24150550 23767369 1.02
clickbench_q08/datafusion:vortex-compact 243254351 246384086 0.99
clickbench_q09/datafusion:vortex-compact 406104422 405614982 1.00
clickbench_q10/datafusion:vortex-compact 112416732 110798577 1.01
clickbench_q11/datafusion:vortex-compact 150628212 149729285 1.01
clickbench_q12/datafusion:vortex-compact 226635842 235022262 0.96
clickbench_q13/datafusion:vortex-compact 385113987 393504685 0.98
clickbench_q14/datafusion:vortex-compact 244950311 247688332 0.99
clickbench_q15/datafusion:vortex-compact 199162964 199967871 1.00
clickbench_q16/datafusion:vortex-compact 494862286 501434686 0.99
clickbench_q17/datafusion:vortex-compact 521016813 489667358 1.06
clickbench_q18/datafusion:vortex-compact 917531237 910101164 1.01
clickbench_q19/datafusion:vortex-compact 23499415 23231677 1.01
clickbench_q20/datafusion:vortex-compact 242462892 238795054 1.02
clickbench_q21/datafusion:vortex-compact 346891246 349984024 0.99
clickbench_q22/datafusion:vortex-compact 552155772 556523174 0.99
clickbench_q23/datafusion:vortex-compact 1576697468 1560536681 1.01
clickbench_q24/datafusion:vortex-compact 72267403 70526198 1.02
clickbench_q25/datafusion:vortex-compact 108002150 106054721 1.02
clickbench_q26/datafusion:vortex-compact 69750103 71274266 0.98
clickbench_q27/datafusion:vortex-compact 322273434 328780520 0.98
clickbench_q28/datafusion:vortex-compact 1576810851 1535408725 1.03
clickbench_q29/datafusion:vortex-compact 80880319 76721267 1.05
clickbench_q30/datafusion:vortex-compact 268957272 268391094 1.00
clickbench_q31/datafusion:vortex-compact 297956481 293418903 1.02
clickbench_q32/datafusion:vortex-compact 854210370 833551350 1.02
clickbench_q33/datafusion:vortex-compact 1060645955 1036221992 1.02
clickbench_q34/datafusion:vortex-compact 1049515878 1037828918 1.01
clickbench_q35/datafusion:vortex-compact 181863027 172779149 1.05
clickbench_q36/datafusion:vortex-compact 🚀 61083394 71719049 0.85
clickbench_q37/datafusion:vortex-compact 29828053 30244149 0.99
clickbench_q38/datafusion:vortex-compact 18866698 19148625 0.99
clickbench_q39/datafusion:vortex-compact 140484259 141543881 0.99
clickbench_q40/datafusion:vortex-compact 15634684 16359471 0.96
clickbench_q41/datafusion:vortex-compact 17263079 16854171 1.02
clickbench_q42/datafusion:vortex-compact 13790451 13717799 1.01
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1962788 1967969 1.00
clickbench_q01/datafusion:parquet 17216551 17524360 0.98
clickbench_q02/datafusion:parquet 33623688 32236912 1.04
clickbench_q03/datafusion:parquet 28006730 26834396 1.04
clickbench_q04/datafusion:parquet 175797797 175389643 1.00
clickbench_q05/datafusion:parquet 233113204 232111244 1.00
clickbench_q06/datafusion:parquet 1943491 1923192 1.01
clickbench_q07/datafusion:parquet 18026797 17831677 1.01
clickbench_q08/datafusion:parquet 230564408 235869697 0.98
clickbench_q09/datafusion:parquet 378432414 367261038 1.03
clickbench_q10/datafusion:parquet 72173545 72180786 1.00
clickbench_q11/datafusion:parquet 94115333 91234141 1.03
clickbench_q12/datafusion:parquet 237888883 237243988 1.00
clickbench_q13/datafusion:parquet 398577482 404267730 0.99
clickbench_q14/datafusion:parquet 251268522 255801324 0.98
clickbench_q15/datafusion:parquet 193169256 195103567 0.99
clickbench_q16/datafusion:parquet 480386544 483262185 0.99
clickbench_q17/datafusion:parquet 479731649 478508328 1.00
clickbench_q18/datafusion:parquet 924940165 937478140 0.99
clickbench_q19/datafusion:parquet 23330672 23567154 0.99
clickbench_q20/datafusion:parquet 465531581 468944866 0.99
clickbench_q21/datafusion:parquet 491239761 487543215 1.01
clickbench_q22/datafusion:parquet 659850278 645546290 1.02
clickbench_q23/datafusion:parquet 2865927577 2858443129 1.00
clickbench_q24/datafusion:parquet 49979579 49002296 1.02
clickbench_q25/datafusion:parquet 97694789 98213802 0.99
clickbench_q26/datafusion:parquet 50218683 50277484 1.00
clickbench_q27/datafusion:parquet 535977825 541823646 0.99
clickbench_q28/datafusion:parquet 1532742531 1537748214 1.00
clickbench_q29/datafusion:parquet 42581077 45032374 0.95
clickbench_q30/datafusion:parquet 244630714 244204471 1.00
clickbench_q31/datafusion:parquet 278509645 279062288 1.00
clickbench_q32/datafusion:parquet 846456407 854154202 0.99
clickbench_q33/datafusion:parquet 1070259952 1091305620 0.98
clickbench_q34/datafusion:parquet 1097816723 1061409528 1.03
clickbench_q35/datafusion:parquet 167676791 166671920 1.01
clickbench_q36/datafusion:parquet 117511873 120118811 0.98
clickbench_q37/datafusion:parquet 47706872 47582950 1.00
clickbench_q38/datafusion:parquet 71427358 68709051 1.04
clickbench_q39/datafusion:parquet 229765630 232303050 0.99
clickbench_q40/datafusion:parquet 26438094 26039977 1.02
clickbench_q41/datafusion:parquet 24336086 24759665 0.98
clickbench_q42/datafusion:parquet 26225370 25743610 1.02
duckdb / vortex-file-compressed / ns (0.995x ➖, 4↑ 2↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚀 11061587 12716958 0.87
clickbench_q01/duckdb:vortex-file-compressed 🚀 18095119 22032714 0.82
clickbench_q02/duckdb:vortex-file-compressed 21408325 22543677 0.95
clickbench_q03/duckdb:vortex-file-compressed 34359454 35927114 0.96
clickbench_q04/duckdb:vortex-file-compressed 131291151 132664525 0.99
clickbench_q05/duckdb:vortex-file-compressed 160801373 164057142 0.98
clickbench_q06/duckdb:vortex-file-compressed 🚀 17552332 21483127 0.82
clickbench_q07/duckdb:vortex-file-compressed 🚀 21596997 24464929 0.88
clickbench_q08/duckdb:vortex-file-compressed 166701063 165626405 1.01
clickbench_q09/duckdb:vortex-file-compressed 207195151 201825923 1.03
clickbench_q10/duckdb:vortex-file-compressed 65666700 67258733 0.98
clickbench_q11/duckdb:vortex-file-compressed 69940879 71125168 0.98
clickbench_q12/duckdb:vortex-file-compressed 193970982 195138632 0.99
clickbench_q13/duckdb:vortex-file-compressed 348121096 341441849 1.02
clickbench_q14/duckdb:vortex-file-compressed 210556115 216842772 0.97
clickbench_q15/duckdb:vortex-file-compressed 184015490 189173829 0.97
clickbench_q16/duckdb:vortex-file-compressed 397895437 384964505 1.03
clickbench_q17/duckdb:vortex-file-compressed 380298803 377694157 1.01
clickbench_q18/duckdb:vortex-file-compressed 749384719 746489936 1.00
clickbench_q19/duckdb:vortex-file-compressed 24627823 25703098 0.96
clickbench_q20/duckdb:vortex-file-compressed 250866554 238661344 1.05
clickbench_q21/duckdb:vortex-file-compressed 341835636 341321578 1.00
clickbench_q22/duckdb:vortex-file-compressed 486985046 497048396 0.98
clickbench_q23/duckdb:vortex-file-compressed 226669592 213105899 1.06
clickbench_q24/duckdb:vortex-file-compressed 58885269 57725490 1.02
clickbench_q25/duckdb:vortex-file-compressed 78761458 75956498 1.04
clickbench_q26/duckdb:vortex-file-compressed 77070893 73392422 1.05
clickbench_q27/duckdb:vortex-file-compressed 177271803 195148731 0.91
clickbench_q28/duckdb:vortex-file-compressed 🚨 1456902176 1274973977 1.14
clickbench_q29/duckdb:vortex-file-compressed 27722714 25771917 1.08
clickbench_q30/duckdb:vortex-file-compressed 170195968 161182816 1.06
clickbench_q31/duckdb:vortex-file-compressed 329215872 318862125 1.03
clickbench_q32/duckdb:vortex-file-compressed 921285397 931500168 0.99
clickbench_q33/duckdb:vortex-file-compressed 1109708354 1100606280 1.01
clickbench_q34/duckdb:vortex-file-compressed 1171484200 1152960643 1.02
clickbench_q35/duckdb:vortex-file-compressed 208468134 210449614 0.99
clickbench_q36/duckdb:vortex-file-compressed 40695296 40944699 0.99
clickbench_q37/duckdb:vortex-file-compressed 28711749 27189072 1.06
clickbench_q38/duckdb:vortex-file-compressed 🚨 37103809 31412778 1.18
clickbench_q39/duckdb:vortex-file-compressed 54608109 55795530 0.98
clickbench_q40/duckdb:vortex-file-compressed 29840324 27964227 1.07
clickbench_q41/duckdb:vortex-file-compressed 29300498 28915768 1.01
clickbench_q42/duckdb:vortex-file-compressed 26095903 27461865 0.95
duckdb / vortex-compact / ns (0.992x ➖, 4↑ 2↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-compact 🚀 10994048 14909139 0.74
clickbench_q01/duckdb:vortex-compact 🚀 20436732 22730534 0.90
clickbench_q02/duckdb:vortex-compact 34205417 34521433 0.99
clickbench_q03/duckdb:vortex-compact 34343454 34941557 0.98
clickbench_q04/duckdb:vortex-compact 137536399 135342755 1.02
clickbench_q05/duckdb:vortex-compact 171159211 163962936 1.04
clickbench_q06/duckdb:vortex-compact 🚀 16584311 18641366 0.89
clickbench_q07/duckdb:vortex-compact 24606511 25587827 0.96
clickbench_q08/duckdb:vortex-compact 182049453 180134133 1.01
clickbench_q09/duckdb:vortex-compact 257914898 257993567 1.00
clickbench_q10/duckdb:vortex-compact 77676629 80138935 0.97
clickbench_q11/duckdb:vortex-compact 99289197 97835076 1.01
clickbench_q12/duckdb:vortex-compact 198623738 201500280 0.99
clickbench_q13/duckdb:vortex-compact 364562387 346437572 1.05
clickbench_q14/duckdb:vortex-compact 214948688 207598828 1.04
clickbench_q15/duckdb:vortex-compact 189290016 187622788 1.01
clickbench_q16/duckdb:vortex-compact 425455871 423084867 1.01
clickbench_q17/duckdb:vortex-compact 393617187 377444642 1.04
clickbench_q18/duckdb:vortex-compact 739286984 756953278 0.98
clickbench_q19/duckdb:vortex-compact 25684134 25527216 1.01
clickbench_q20/duckdb:vortex-compact 200142852 206327675 0.97
clickbench_q21/duckdb:vortex-compact 300590065 320010467 0.94
clickbench_q22/duckdb:vortex-compact 472692748 474985887 1.00
clickbench_q23/duckdb:vortex-compact 🚨 341505212 296291766 1.15
clickbench_q24/duckdb:vortex-compact 80497225 76679037 1.05
clickbench_q25/duckdb:vortex-compact 92819991 96506251 0.96
clickbench_q26/duckdb:vortex-compact 80529335 79929037 1.01
clickbench_q27/duckdb:vortex-compact 382703119 383175132 1.00
clickbench_q28/duckdb:vortex-compact 1548483745 1588808801 0.97
clickbench_q29/duckdb:vortex-compact 37903540 39628476 0.96
clickbench_q30/duckdb:vortex-compact 199620901 195844256 1.02
clickbench_q31/duckdb:vortex-compact 🚀 330386253 377596765 0.87
clickbench_q32/duckdb:vortex-compact 951086294 931354699 1.02
clickbench_q33/duckdb:vortex-compact 1083618665 1023826851 1.06
clickbench_q34/duckdb:vortex-compact 1097712887 1076900098 1.02
clickbench_q35/duckdb:vortex-compact 217136131 220392089 0.99
clickbench_q36/duckdb:vortex-compact 🚨 43353437 38224795 1.13
clickbench_q37/duckdb:vortex-compact 32643590 35056905 0.93
clickbench_q38/duckdb:vortex-compact 34755118 32537857 1.07
clickbench_q39/duckdb:vortex-compact 58172959 55996375 1.04
clickbench_q40/duckdb:vortex-compact 28914744 29955988 0.97
clickbench_q41/duckdb:vortex-compact 31639888 30785140 1.03
clickbench_q42/duckdb:vortex-compact 27375412 27488518 1.00
duckdb / parquet / ns (0.999x ➖, 1↑ 1↓)
name PR 3062ebb (ns) base ad5de22 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 16449635 17039834 0.97
clickbench_q01/duckdb:parquet 18180857 18118120 1.00
clickbench_q02/duckdb:parquet 23695864 23844564 0.99
clickbench_q03/duckdb:parquet 25156625 26175394 0.96
clickbench_q04/duckdb:parquet 130031148 130175850 1.00
clickbench_q05/duckdb:parquet 192133416 200088188 0.96
clickbench_q06/duckdb:parquet 23216107 22285251 1.04
clickbench_q07/duckdb:parquet 🚨 20668352 18629681 1.11
clickbench_q08/duckdb:parquet 163305797 162927481 1.00
clickbench_q09/duckdb:parquet 231005549 231089783 1.00
clickbench_q10/duckdb:parquet 57953619 57596688 1.01
clickbench_q11/duckdb:parquet 66596334 66820555 1.00
clickbench_q12/duckdb:parquet 172033467 172065304 1.00
clickbench_q13/duckdb:parquet 309922518 306268993 1.01
clickbench_q14/duckdb:parquet 187417843 187332711 1.00
clickbench_q15/duckdb:parquet 182112850 182960199 1.00
clickbench_q16/duckdb:parquet 356377923 357725768 1.00
clickbench_q17/duckdb:parquet 364630752 358935212 1.02
clickbench_q18/duckdb:parquet 688332136 686780927 1.00
clickbench_q19/duckdb:parquet 21531565 21045544 1.02
clickbench_q20/duckdb:parquet 262825664 267682753 0.98
clickbench_q21/duckdb:parquet 318975161 319880848 1.00
clickbench_q22/duckdb:parquet 467325449 473512791 0.99
clickbench_q23/duckdb:parquet 250733014 246310388 1.02
clickbench_q24/duckdb:parquet 70792567 71879323 0.98
clickbench_q25/duckdb:parquet 72412010 72136889 1.00
clickbench_q26/duckdb:parquet 49865025 48789910 1.02
clickbench_q27/duckdb:parquet 270606814 276450128 0.98
clickbench_q28/duckdb:parquet 1751990441 1759157086 1.00
clickbench_q29/duckdb:parquet 26737065 27073723 0.99
clickbench_q30/duckdb:parquet 177770255 176663342 1.01
clickbench_q31/duckdb:parquet 329986871 310652256 1.06
clickbench_q32/duckdb:parquet 903651942 910213946 0.99
clickbench_q33/duckdb:parquet 785564486 778849557 1.01
clickbench_q34/duckdb:parquet 791258468 799727626 0.99
clickbench_q35/duckdb:parquet 208282166 209440161 0.99
clickbench_q36/duckdb:parquet 🚀 48557909 56985705 0.85
clickbench_q37/duckdb:parquet 37497117 36155421 1.04
clickbench_q38/duckdb:parquet 37346071 37662187 0.99
clickbench_q39/duckdb:parquet 84496535 85731274 0.99
clickbench_q40/duckdb:parquet 21347037 20337598 1.05
clickbench_q41/duckdb:parquet 19960110 20827046 0.96
clickbench_q42/duckdb:parquet 23141979 22989405 1.01

No file size changes detected.

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.1%
Engines: DataFusion No clear signal (-1.3%, low confidence) · DuckDB No clear signal (-0.9%, environment too noisy confidence)
Vortex (geomean): 0.996x ➖
Parquet (geomean): 1.007x ➖
Shifts: Parquet (control) +0.7% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (0.987x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base 39fde8c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 352918478 344516732 1.02
tpch_q02/datafusion:vortex-file-compressed 100586022 102167801 0.98
tpch_q03/datafusion:vortex-file-compressed 159912333 158456397 1.01
tpch_q04/datafusion:vortex-file-compressed 68980986 69619343 0.99
tpch_q05/datafusion:vortex-file-compressed 269779744 271940288 0.99
tpch_q06/datafusion:vortex-file-compressed 26509601 27748657 0.96
tpch_q07/datafusion:vortex-file-compressed 366520162 366622198 1.00
tpch_q08/datafusion:vortex-file-compressed 287217710 286108616 1.00
tpch_q09/datafusion:vortex-file-compressed 484514687 488287018 0.99
tpch_q10/datafusion:vortex-file-compressed 177772738 181402137 0.98
tpch_q11/datafusion:vortex-file-compressed 73839769 79292917 0.93
tpch_q12/datafusion:vortex-file-compressed 89944658 87034557 1.03
tpch_q13/datafusion:vortex-file-compressed 119727379 121406795 0.99
tpch_q14/datafusion:vortex-file-compressed 41513007 43073516 0.96
tpch_q15/datafusion:vortex-file-compressed 74271445 74192071 1.00
tpch_q16/datafusion:vortex-file-compressed 69036636 74630117 0.93
tpch_q17/datafusion:vortex-file-compressed 430338612 435981908 0.99
tpch_q18/datafusion:vortex-file-compressed 622876390 649980662 0.96
tpch_q19/datafusion:vortex-file-compressed 67249638 64724220 1.04
tpch_q20/datafusion:vortex-file-compressed 137271166 137710481 1.00
tpch_q21/datafusion:vortex-file-compressed 465924548 486833216 0.96
tpch_q22/datafusion:vortex-file-compressed 42091869 41376892 1.02
datafusion / vortex-compact / ns (0.993x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base 39fde8c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 353010127 357934621 0.99
tpch_q02/datafusion:vortex-compact 103431915 103833187 1.00
tpch_q03/datafusion:vortex-compact 157509744 163898627 0.96
tpch_q04/datafusion:vortex-compact 85771713 85408454 1.00
tpch_q05/datafusion:vortex-compact 280012623 274073757 1.02
tpch_q06/datafusion:vortex-compact 39102128 39996332 0.98
tpch_q07/datafusion:vortex-compact 369208800 370989371 1.00
tpch_q08/datafusion:vortex-compact 282321515 293178121 0.96
tpch_q09/datafusion:vortex-compact 476377745 483964508 0.98
tpch_q10/datafusion:vortex-compact 190489543 193120510 0.99
tpch_q11/datafusion:vortex-compact 74581382 75494385 0.99
tpch_q12/datafusion:vortex-compact 126042854 123280662 1.02
tpch_q13/datafusion:vortex-compact 148432076 149042939 1.00
tpch_q14/datafusion:vortex-compact 53900956 53314963 1.01
tpch_q15/datafusion:vortex-compact 108711059 108075540 1.01
tpch_q16/datafusion:vortex-compact 78283341 78657200 1.00
tpch_q17/datafusion:vortex-compact 432634362 440567951 0.98
tpch_q18/datafusion:vortex-compact 657901333 667072308 0.99
tpch_q19/datafusion:vortex-compact 155266012 148463648 1.05
tpch_q20/datafusion:vortex-compact 150816492 150603646 1.00
tpch_q21/datafusion:vortex-compact 492867903 494408716 1.00
tpch_q22/datafusion:vortex-compact 46893316 50102875 0.94
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base 39fde8c (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 323568005 326526222 0.99
tpch_q02/datafusion:parquet 220918789 213921967 1.03
tpch_q03/datafusion:parquet 228968620 230420356 0.99
tpch_q04/datafusion:parquet 101725823 100324991 1.01
tpch_q05/datafusion:parquet 364033694 361513506 1.01
tpch_q06/datafusion:parquet 72427925 74440704 0.97
tpch_q07/datafusion:parquet 517813427 514417071 1.01
tpch_q08/datafusion:parquet 403973973 404282204 1.00
tpch_q09/datafusion:parquet 667772781 671496557 0.99
tpch_q10/datafusion:parquet 552141256 555523302 0.99
tpch_q11/datafusion:parquet 157393728 153360419 1.03
tpch_q12/datafusion:parquet 149599381 150730528 0.99
tpch_q13/datafusion:parquet 357126929 351420686 1.02
tpch_q14/datafusion:parquet 119910571 119764825 1.00
tpch_q15/datafusion:parquet 190045789 190596765 1.00
tpch_q16/datafusion:parquet 148947405 147001638 1.01
tpch_q17/datafusion:parquet 505866789 508432206 0.99
tpch_q18/datafusion:parquet 719806825 702494894 1.02
tpch_q19/datafusion:parquet 197807581 191861370 1.03
tpch_q20/datafusion:parquet 293965283 303149795 0.97
tpch_q21/datafusion:parquet 540662359 545438240 0.99
tpch_q22/datafusion:parquet 252367167 253574763 1.00
duckdb / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base 39fde8c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 89123034 88925387 1.00
tpch_q02/duckdb:vortex-file-compressed 73194996 70565103 1.04
tpch_q03/duckdb:vortex-file-compressed 138269827 138250898 1.00
tpch_q04/duckdb:vortex-file-compressed 166876786 165562409 1.01
tpch_q05/duckdb:vortex-file-compressed 151888950 149119628 1.02
tpch_q06/duckdb:vortex-file-compressed 38863211 38838028 1.00
tpch_q07/duckdb:vortex-file-compressed 137982767 141531444 0.97
tpch_q08/duckdb:vortex-file-compressed 184267258 181781022 1.01
tpch_q09/duckdb:vortex-file-compressed 295615328 306112118 0.97
tpch_q10/duckdb:vortex-file-compressed 221590498 219301398 1.01
tpch_q11/duckdb:vortex-file-compressed 41670346 40661932 1.02
tpch_q12/duckdb:vortex-file-compressed 115513226 119915708 0.96
tpch_q13/duckdb:vortex-file-compressed 168266747 174332489 0.97
tpch_q14/duckdb:vortex-file-compressed 60451585 58392316 1.04
tpch_q15/duckdb:vortex-file-compressed 91312930 93404377 0.98
tpch_q16/duckdb:vortex-file-compressed 85499285 85086865 1.00
tpch_q17/duckdb:vortex-file-compressed 107806487 107673358 1.00
tpch_q18/duckdb:vortex-file-compressed 257738639 257149069 1.00
tpch_q19/duckdb:vortex-file-compressed 84856363 84859884 1.00
tpch_q20/duckdb:vortex-file-compressed 151311201 148402228 1.02
tpch_q21/duckdb:vortex-file-compressed 492724200 481254843 1.02
tpch_q22/duckdb:vortex-file-compressed 77696667 77295060 1.01
duckdb / vortex-compact / ns (1.002x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base 39fde8c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 111620940 110809607 1.01
tpch_q02/duckdb:vortex-compact 73874935 77517243 0.95
tpch_q03/duckdb:vortex-compact 127205298 126758835 1.00
tpch_q04/duckdb:vortex-compact 159302308 157071261 1.01
tpch_q05/duckdb:vortex-compact 151958419 149977293 1.01
tpch_q06/duckdb:vortex-compact 41979080 41446165 1.01
tpch_q07/duckdb:vortex-compact 141239818 139436286 1.01
tpch_q08/duckdb:vortex-compact 186277009 184885829 1.01
tpch_q09/duckdb:vortex-compact 314548555 307818845 1.02
tpch_q10/duckdb:vortex-compact 214231971 217386692 0.99
tpch_q11/duckdb:vortex-compact 43350541 46727090 0.93
tpch_q12/duckdb:vortex-compact 120169497 122207923 0.98
tpch_q13/duckdb:vortex-compact 176701283 170421982 1.04
tpch_q14/duckdb:vortex-compact 64327822 64139356 1.00
tpch_q15/duckdb:vortex-compact 95737815 93964088 1.02
tpch_q16/duckdb:vortex-compact 88580932 87531040 1.01
tpch_q17/duckdb:vortex-compact 108524478 107998780 1.00
tpch_q18/duckdb:vortex-compact 255762873 244901340 1.04
tpch_q19/duckdb:vortex-compact 86926657 88679043 0.98
tpch_q20/duckdb:vortex-compact 152512782 150034419 1.02
tpch_q21/duckdb:vortex-compact 481283096 478160007 1.01
tpch_q22/duckdb:vortex-compact 79776064 81144245 0.98
duckdb / parquet / ns (1.011x ➖, 0↑ 1↓)
name PR 3062ebb (ns) base 39fde8c (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 154341468 100159109 1.54
tpch_q02/duckdb:parquet 108021319 100564252 1.07
tpch_q03/duckdb:parquet 157254920 167014757 0.94
tpch_q04/duckdb:parquet 116856375 119902118 0.97
tpch_q05/duckdb:parquet 183594137 186212780 0.99
tpch_q06/duckdb:parquet 59483025 58364161 1.02
tpch_q07/duckdb:parquet 139524277 148412729 0.94
tpch_q08/duckdb:parquet 214573011 217563746 0.99
tpch_q09/duckdb:parquet 348440823 349396521 1.00
tpch_q10/duckdb:parquet 650930987 652085161 1.00
tpch_q11/duckdb:parquet 41146776 41370907 0.99
tpch_q12/duckdb:parquet 116675298 118751003 0.98
tpch_q13/duckdb:parquet 396706447 395370321 1.00
tpch_q14/duckdb:parquet 152024407 152863496 0.99
tpch_q15/duckdb:parquet 75835433 78666730 0.96
tpch_q16/duckdb:parquet 153870479 155312027 0.99
tpch_q17/duckdb:parquet 112925769 115898510 0.97
tpch_q18/duckdb:parquet 300172301 300469622 1.00
tpch_q19/duckdb:parquet 234415314 231378459 1.01
tpch_q20/duckdb:parquet 198089925 197804290 1.00
tpch_q21/duckdb:parquet 432933562 442562565 0.98
tpch_q22/duckdb:parquet 334917290 335494678 1.00

No file size changes detected.

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -7.9%
Engines: DataFusion No clear signal (-2.6%, environment too noisy confidence) · DuckDB No clear signal (-12.8%, environment too noisy confidence)
Vortex (geomean): 0.976x ➖
Parquet (geomean): 1.059x ➖
Shifts: Parquet (control) +5.9% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed / ns (0.985x ➖, 0↑ 1↓)
name PR 3062ebb (ns) base 2b3109a (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 47034055 43055796 1.09
fineweb_q01/datafusion:vortex-file-compressed 453359729 385999005 1.17
fineweb_q02/datafusion:vortex-file-compressed 🚨 631928926 383697169 1.65
fineweb_q03/datafusion:vortex-file-compressed 621544058 801749146 0.78
fineweb_q04/datafusion:vortex-file-compressed 475282319 476224603 1.00
fineweb_q05/datafusion:vortex-file-compressed 368187952 414393340 0.89
fineweb_q06/datafusion:vortex-file-compressed 750730462 1031294298 0.73
fineweb_q07/datafusion:vortex-file-compressed 479922970 559318126 0.86
fineweb_q08/datafusion:vortex-file-compressed 342411288 356878153 0.96
datafusion / vortex-compact / ns (0.929x ➖, 1↑ 1↓)
name PR 3062ebb (ns) base 2b3109a (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 59279826 41456257 1.43
fineweb_q01/datafusion:vortex-compact 462142858 493263593 0.94
fineweb_q02/datafusion:vortex-compact 581565302 570624494 1.02
fineweb_q03/datafusion:vortex-compact 826745455 805855465 1.03
fineweb_q04/datafusion:vortex-compact 739455551 750651854 0.99
fineweb_q05/datafusion:vortex-compact 644999263 645108398 1.00
fineweb_q06/datafusion:vortex-compact 695180534 939866312 0.74
fineweb_q07/datafusion:vortex-compact 579836244 672923551 0.86
fineweb_q08/datafusion:vortex-compact 🚀 193010896 330385947 0.58
datafusion / parquet / ns (0.982x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base 2b3109a (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 510691261 510817202 1.00
fineweb_q01/datafusion:parquet 931671749 910377558 1.02
fineweb_q02/datafusion:parquet 1040721074 978454737 1.06
fineweb_q03/datafusion:parquet 1015094978 1038651990 0.98
fineweb_q04/datafusion:parquet 1028078600 1132748097 0.91
fineweb_q05/datafusion:parquet 970165956 968409763 1.00
fineweb_q06/datafusion:parquet 872328868 968874070 0.90
fineweb_q07/datafusion:parquet 991409262 994366911 1.00
fineweb_q08/datafusion:parquet 981491782 1002625740 0.98
duckdb / vortex-file-compressed / ns (1.014x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base 2b3109a (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 50008723 51602547 0.97
fineweb_q01/duckdb:vortex-file-compressed 677942984 588943604 1.15
fineweb_q02/duckdb:vortex-file-compressed 531095198 561486671 0.95
fineweb_q03/duckdb:vortex-file-compressed 1595302412 1534345152 1.04
fineweb_q04/duckdb:vortex-file-compressed 1908122318 1838505413 1.04
fineweb_q05/duckdb:vortex-file-compressed 1689062473 1749208495 0.97
fineweb_q06/duckdb:vortex-file-compressed 1812848719 1729749128 1.05
fineweb_q07/duckdb:vortex-file-compressed 1598254389 1591670029 1.00
fineweb_q08/duckdb:vortex-file-compressed 705437368 721079925 0.98
duckdb / vortex-compact / ns (0.977x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base 2b3109a (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 57815069 63318109 0.91
fineweb_q01/duckdb:vortex-compact 625975137 791387296 0.79
fineweb_q02/duckdb:vortex-compact 701540323 624958927 1.12
fineweb_q03/duckdb:vortex-compact 1698757519 1618677159 1.05
fineweb_q04/duckdb:vortex-compact 1701387375 1679709712 1.01
fineweb_q05/duckdb:vortex-compact 1630253713 1673880517 0.97
fineweb_q06/duckdb:vortex-compact 1700181526 1734945040 0.98
fineweb_q07/duckdb:vortex-compact 1594657953 1607961805 0.99
fineweb_q08/duckdb:vortex-compact 599252143 603279664 0.99
duckdb / parquet / ns (1.141x ➖, 0↑ 1↓)
name PR 3062ebb (ns) base 2b3109a (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 5232803800 5297190598 0.99
fineweb_q01/duckdb:parquet 5319129460 5343486664 1.00
fineweb_q02/duckdb:parquet 5324959007 5370099619 0.99
fineweb_q03/duckdb:parquet 5349349669 5410525721 0.99
fineweb_q04/duckdb:parquet 5313055518 5312887527 1.00
fineweb_q05/duckdb:parquet 5323467903 5343475301 1.00
fineweb_q06/duckdb:parquet 🚨 5392882544 1570986366 3.43
fineweb_q07/duckdb:parquet 5372520719 5361970707 1.00
fineweb_q08/duckdb:parquet 5237184743 5260032020 1.00

@joseph-isaacs joseph-isaacs added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Aug 7, 2026
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Aug 7, 2026
@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖


vortex / vortex-file-compressed / ns (0.991x ➖, 3↑ 0↓)
name PR 3062ebb (ns) base 0f0390a (ns) ratio (PR/base)
compress time/Arade 879018153 893858036 0.98
compress time/Bimbo 5142445434 5164656517 1.00
compress time/CMSprovider 2748504296 2782463449 0.99
compress time/Euro2016 383289286 382372892 1.00
compress time/Food 🚀 350547241 391099455 0.90
compress time/HashTags 749862726 746110586 1.01
compress time/TPC-H l_comment canonical 1205697255 1201431945 1.00
compress time/TPC-H l_comment chunked 1218748314 1168944017 1.04
compress time/taxi 558462460 530789706 1.05
compress time/wide table cols=100 chunks=1 rows=1000 8888301 8842939 1.01
compress time/wide table cols=100 chunks=50 rows=1000 8975692 9138733 0.98
compress time/wide table cols=1000 chunks=1 rows=1000 92006825 89572738 1.03
compress time/wide table cols=1000 chunks=50 rows=1000 92330282 93316318 0.99
compress time/wide table cols=10000 chunks=1 rows=1000 1096013471 1041081638 1.05
compress time/wide table cols=10000 chunks=50 rows=1000 1100150647 1076640214 1.02
decompress time/Arade 22749480 22994045 0.99
decompress time/Bimbo 80669536 82822341 0.97
decompress time/CMSprovider 63359134 63913972 0.99
decompress time/Euro2016 17509607 17694063 0.99
decompress time/Food 7763425 7621253 1.02
decompress time/HashTags 93934461 93004483 1.01
decompress time/TPC-H l_comment canonical 37455621 37334352 1.00
decompress time/TPC-H l_comment chunked 37185102 37901864 0.98
decompress time/taxi 14672169 14692649 1.00
decompress time/wide table cols=100 chunks=1 rows=1000 2480297 2527819 0.98
decompress time/wide table cols=100 chunks=50 rows=1000 2792863 2582856 1.08
decompress time/wide table cols=1000 chunks=1 rows=1000 23787732 24165158 0.98
decompress time/wide table cols=1000 chunks=50 rows=1000 25201476 25839986 0.98
decompress time/wide table cols=10000 chunks=1 rows=1000 🚀 267326038 311823302 0.86
decompress time/wide table cols=10000 chunks=50 rows=1000 🚀 272603721 311640454 0.87
vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)
name PR 3062ebb (bytes) base 0f0390a (bytes) ratio (PR/base)
vortex-file-compressed size/Arade 145358300 145358300 1.00
vortex-file-compressed size/Bimbo 467257796 467257796 1.00
vortex-file-compressed size/CMSprovider 417789620 417789620 1.00
vortex-file-compressed size/Euro2016 162120188 162354364 1.00
vortex-file-compressed size/Food 41977336 41977336 1.00
vortex-file-compressed size/HashTags 184888244 184888244 1.00
vortex-file-compressed size/TPC-H l_comment canonical 172639984 172639984 1.00
vortex-file-compressed size/TPC-H l_comment chunked 172639984 172639984 1.00
vortex-file-compressed size/taxi 52296516 52296516 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 932760 932760 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 932760 932760 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9309960 9309960 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9309960 9309960 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93117960 93117960 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93117960 93117960 1.00
vortex / vortex-file-compressed / ratio (0.999x ➖, 2↑ 1↓)
name PR 3062ebb (ratio) base 0f0390a (ratio) ratio (PR/base)
vortex:parquet-zstd ratio compress time/Arade 0.29250918 0.294375788 0.99
vortex:parquet-zstd ratio compress time/Bimbo 0.349697389 0.342714546 1.02
vortex:parquet-zstd ratio compress time/CMSprovider 0.343866666 0.349203126 0.98
vortex:parquet-zstd ratio compress time/Euro2016 0.250244914 0.251941291 0.99
vortex:parquet-zstd ratio compress time/Food 🚀 0.375713397 0.421474992 0.89
vortex:parquet-zstd ratio compress time/HashTags 0.3033605 0.301411482 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0.321465309 0.321055648 1.00
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0.324796992 0.308737694 1.05
vortex:parquet-zstd ratio compress time/taxi 0.397995247 0.375767913 1.06
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1.3685249 1.35810076 1.01
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1.38370804 1.41008918 0.98
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1.17401197 1.1529838 1.02
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1.19031911 1.18901574 1.00
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1.29278459 1.21393687 1.06
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1.30203195 1.25881684 1.03
vortex:parquet-zstd ratio decompress time/Arade 0.031865577 0.031952023 1.00
vortex:parquet-zstd ratio decompress time/Bimbo 0.0410971731 0.0420119741 0.98
vortex:parquet-zstd ratio decompress time/CMSprovider 0.0325970205 0.0328594695 0.99
vortex:parquet-zstd ratio decompress time/Euro2016 0.040431979 0.0409794599 0.99
vortex:parquet-zstd ratio decompress time/Food 0.0344359005 0.0338277405 1.02
vortex:parquet-zstd ratio decompress time/HashTags 0.13349657 0.131473543 1.02
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0.0537348564 0.0539193483 1.00
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0.053527844 0.0545782581 0.98
vortex:parquet-zstd ratio decompress time/taxi 0.051170441 0.0513727594 1.00
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0.997025762 0.999051071 1.00
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 🚨 1.13548187 1.03115927 1.10
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0.83606458 0.826888832 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0.891533822 0.868904997 1.03
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚀 0.84588618 0.957560118 0.88
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0.860610864 0.955799567 0.90
vortex:parquet-zstd size/Arade 0.563373077 0.563373077 1.00
vortex:parquet-zstd size/Bimbo 1.21518019 1.21518019 1.00
vortex:parquet-zstd size/CMSprovider 1.10853182 1.10853182 1.00
vortex:parquet-zstd size/Euro2016 1.31831291 1.32021716 1.00
vortex:parquet-zstd size/Food 1.17585221 1.17585221 1.00
vortex:parquet-zstd size/HashTags 1.38481715 1.38481715 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1.09018632 1.09018632 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1.09018632 1.09018632 1.00
vortex:parquet-zstd size/taxi 0.945967392 0.945967392 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1.00038181 1.00038181 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1.00038181 1.00038181 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0.99849378 0.99849378 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0.99849378 0.99849378 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0.998691077 0.998691077 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0.998691077 0.998691077 1.00
vortex / parquet / ns (0.992x ➖, 0↑ 0↓)
name PR 3062ebb (ns) base 0f0390a (ns) ratio (PR/base)
parquet_rs-zstd compress time/Arade 3005095958 3036452291 0.99
parquet_rs-zstd compress time/Bimbo 14705415567 15069849193 0.98
parquet_rs-zstd compress time/CMSprovider 7992936115 7968037058 1.00
parquet_rs-zstd compress time/Euro2016 1531656645 1517706327 1.01
parquet_rs-zstd compress time/Food 933017677 927930393 1.01
parquet_rs-zstd compress time/HashTags 2471853544 2475388728 1.00
parquet_rs-zstd compress time/TPC-H l_comment canonical 3750629449 3742129915 1.00
parquet_rs-zstd compress time/TPC-H l_comment chunked 3752338669 3786204408 0.99
parquet_rs-zstd compress time/taxi 1403188768 1412546649 0.99
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6494804 6511254 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6486695 6480961 1.00
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 78369580 77687768 1.01
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 77567672 78481987 0.99
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 847792804 857607729 0.99
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 844949042 855279479 0.99
parquet_rs-zstd decompress time/Arade 713920227 719642854 0.99
parquet_rs-zstd decompress time/Bimbo 1962897442 1971398461 1.00
parquet_rs-zstd decompress time/CMSprovider 1943709367 1945070114 1.00
parquet_rs-zstd decompress time/Euro2016 433063319 431778824 1.00
parquet_rs-zstd decompress time/Food 225445680 225295952 1.00
parquet_rs-zstd decompress time/HashTags 703647002 707400750 0.99
parquet_rs-zstd decompress time/TPC-H l_comment canonical 697045149 692411040 1.01
parquet_rs-zstd decompress time/TPC-H l_comment chunked 694687086 694449865 1.00
parquet_rs-zstd decompress time/taxi 286731338 286000775 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2487696 2530220 0.98
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2459628 2504808 0.98
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 28452027 29224192 0.97
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 28267549 29738563 0.95
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 316030743 325643577 0.97
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 316756077 326052098 0.97
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
name PR 3062ebb (bytes) base 0f0390a (bytes) ratio (PR/base)
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00

The uniform fast path in `ZonedReader::pruning_evaluation` had no
measurement behind it - the SQL suites cannot resolve a per-split cost
against per-split decode, so two full sweeps disagreed with each other
and neither confirmed nor refuted anything.

This benchmarks the changed code directly. `expand` reproduces the old
behaviour (build a row-aligned buffer, popcount it, intersect) and
`uniform` is the fast path that counts the covering zone bits instead.
The incoming mask is a `Values` mask, not `AllTrue`, so `bitand` takes
the `(AllOr::Some, AllOr::All) => self` branch that the real code hits
rather than the all-true short circuit.

Medians on a c6id-class host, one zone per split at the default 8192-row
zone and block length:

  no zone pruned      7.4 ns  vs  147 ns expanded   (~20x)
  all zones pruned   14.5 ns  vs  151 ns expanded   (~10x)

The gap widens with split length - at 65536 rows over 8 zones the
no-prune case is 7.4 ns against 420 ns. The absolute saving is roughly
140-400 ns per split per pruning expression, which is why it does not
surface in a query-level benchmark: a split then decodes 8192 rows
across every projected column.

`mixed_zones` covers the case where the covering zones genuinely
disagree and the expansion still has to run. It needs at least two zones
to be meaningful, so it takes its own argument set - a one-zone split is
uniform by construction and would silently measure a fast path. There
the added `count_range` shows a small overhead, within a few percent and
at the edge of what this environment resolves, so it is bounded rather
than claimed to be free.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants