Repository navigation
fix(bench): expect stable MSF catalogs during estimate churn - #7264
Conversation
Co-Authored-By: Codex <noreply@openai.com>
Codex Review SummaryThis comment shows the latest Codex review activity on this pull request.
ℹ️ About Codex in GitHubYour team has set up Codex to review pull requests in this repo. Reviews are triggered when you
Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings. |
kixelated
left a comment
There was a problem hiding this comment.
Automated review by review (OpenAI)
Reviewed head 5d2cf767f7eccdd9474d6374c9cd7827b97e89b5 against base 14537ef416a15c2140ae5137993bbbb66425268a.
No actionable findings. The format-specific counts match the producer: hang continues publishing throttled estimate changes, while MSF retains each track's declared estimates and suppresses identical catalog JSON. The new setup assertion checks initial catalog delivery and the aggregate rendition count before accepting zero MSF churn, and the hang cases retain the two-update regression check.
Keeping the MSF sweep rather than skipping it is the right direction. Namespace conversion remains exercised during setup; it is not newly included in the timed estimate-churn closure. Production behavior is unchanged.
Verification: GitHub-only static review of the complete benchmark and relevant catalog producer/freezing logic and tests. No Criterion/Codspeed runs, compilation, CI, or performance measurements were executed; the reported 24-case results were not independently reproduced.
|
No actionable comments were generated in the recent review.
|
|
Merge summary: CI passed (10/10) on head (Written by Claude Opus 5.5) |
Problem
Codspeed run 40902359739 panics in the MSF catalog fanout benchmark. moq-dev/moq#7161 intentionally fixed MSF estimates at declaration, but the benchmark still expects two estimate-driven updates.
Approach
Impact
Validation
(0, 0), expected(2, 2).cargo bench --locked -p moq-mux --bench catalog -- --test: all 24 cases passed.cargo codspeed build --locked -m simulation -p moq-mux --bench catalogandcargo codspeed run -m simulation -p moq-mux --bench catalog: all 24 cases checked locally. Hosted instruction measurements were not run.just ciandgit diff --check: passed.Alternatives
Skipping the MSF cases would lose coverage; changing production would undo the intended suppression.
Follow-ups
None.
(Written by GPT-6.1 Sol)