Skip to content

Build benchmarks on VMs instead of metal instances which we use for runs - #9289

Draft
AdamGS wants to merge 1 commit into
developfrom
adamg/build-vm
Draft

Build benchmarks on VMs instead of metal instances which we use for runs#9289
AdamGS wants to merge 1 commit into
developfrom
adamg/build-vm

Conversation

@AdamGS

@AdamGS AdamGS commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Rationale for this change

Metal capacity will always be limited, better to use VMs for the build step to make better use of it.

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@codspeed-hq

codspeed-hq Bot commented Aug 7, 2026

Copy link
Copy Markdown

Merging this PR will degrade performance by 19.98%

⚡ 1 improved benchmark
❌ 3 regressed benchmarks
✅ 1933 untouched benchmarks
⏩ 85 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation decompress[u64, (1000, 16)] 65.1 µs 133.7 µs -51.31%
Simulation decode_varbin[(1000, 2)] 62.1 µs 78.6 µs -21.02%
Simulation compress_fsst[(1000, 64, 8)] 1 ms 1.2 ms -11.38%
Simulation decompress[u32, (10000, 256)] 100.4 µs 83.5 µs +20.27%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing adamg/build-vm (a0a7e66) with develop (fed7038)

Open in CodSpeed

Footnotes

  1. 85 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant