Skip to content

Migrate benchmarks to MergeQueue#10526

Draft
sarahchen6 wants to merge 1 commit intomasterfrom
sarahchen6/move-benchmarks-to-mq
Draft

Migrate benchmarks to MergeQueue#10526
sarahchen6 wants to merge 1 commit intomasterfrom
sarahchen6/move-benchmarks-to-mq

Conversation

@sarahchen6
Copy link
Contributor

What Does This Do

Run startup, load, and dacapo benchmarks on the merge queue instead of for every PR push. Allow these benchmarks to be run with manual triggers or by setting the CI variable BENCHMARKS=true.

Motivation

By migrating these benchmarks to the merge queue, we can greatly reduce CI runtime (from ~60 min to ~35 min) and support faster development experiences. At the same time, however, we don't want to lose benchmarking ability nor merge in unknown regressions.

Additional Notes

We should ensure existing SLOs to block PRs that introduce major regressions are updated. We can also consider adding a line in the default PR description to suggest manually running benchmarks before adding to the merge queue.

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@sarahchen6 sarahchen6 added type: enhancement Enhancements and improvements tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Feb 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant