Skip to content

[codex] Speed up differential coverage output generation#30

Open
0xalpharush wants to merge 1 commit into
mainfrom
centaur/speed-up-diffcov-output
Open

[codex] Speed up differential coverage output generation#30
0xalpharush wants to merge 1 commit into
mainfrom
centaur/speed-up-diffcov-output

Conversation

@0xalpharush

@0xalpharush 0xalpharush commented Jun 22, 2026

Copy link
Copy Markdown
Collaborator

Summary

This is a performance follow-up to #29. It keeps the new relcov non-inferiority statistics unchanged, but removes avoidable work in write_differential_coverage_outputs().

  • Skip oversized non-combined campaigns before sorting/writing normalized showmap files.
  • Reuse one DifferentialCoverage object per analyzed campaign across relscore, relcov, and verdict generation.
  • Compute relcov tables and per-seed relcov samples from cached approach unions/trials instead of repeatedly constructing one-trial ApproachData objects.
  • Add regression tests for skipped campaign materialization and redundant DifferentialCoverage construction.

Validation

  • uv run --with-requirements analysis/requirements.txt python -m unittest analysis.tests.test_differential_coverage analysis.tests.test_benchmark_report
  • git diff --check origin/main..HEAD

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant