Skip to content

Preserve runner samples and report current rolling outcomes - #79

Merged
gauravtiwari merged 1 commit into
mainfrom
benchmark-reporting
Oct 20, 2026
Merged

gauravtiwari merged 1 commit into
mainfrom
benchmark-reporting

Conversation

@gauravtiwari

@gauravtiwari gauravtiwari commented Oct 20, 2026 •

Copy link
Copy Markdown
Contributor

Runner samples collected on branches lost post-job save timings, and lanes moved to sample-only runs continued blocking current rolling comparisons. Collect enriched artifacts on every branch, publish records only on main, exclude sample-only lanes from rolling matching, and report each active lane's latest recorded outcome beside successful cohorts.

Retain 13 PostHog/Zed sample measurements and nine CLI telemetry files from six existing branch runs. Files match the original artifacts; only the two Namespace native records gain measured post-job save durations and successful job conclusions. Read-only restore/build samples remain separate from native restore/build/save measurements.

Validation: 160 tests and 551 assertions pass; all 32 cases pass bin/bench check; actionlint passes. A full report generation restores the 13-step PostHog x86 1.43.2 comparison. Product behavior and CLI pins are unchanged.

@gauravtiwari
gauravtiwari marked this pull request as ready for review October 20, 2026 14:07
@gauravtiwari
gauravtiwari merged commit d045ec0 into main Oct 20, 2026
4 checks passed
@gauravtiwari
gauravtiwari deleted the benchmark-reporting branch October 20, 2026 14:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant