Skip to content

perf(ci): round-robin shard sequencer + parallel test:init#8241

Closed
VaibhavAcharya wants to merge 7 commits intomainfrom
vaibhavacharya/ci-speed-opt
Closed

perf(ci): round-robin shard sequencer + parallel test:init#8241
VaibhavAcharya wants to merge 7 commits intomainfrom
vaibhavacharya/ci-speed-opt

Conversation

@VaibhavAcharya
Copy link
Copy Markdown
Contributor

@VaibhavAcharya VaibhavAcharya commented May 8, 2026

🎉 Thanks for submitting a pull request! 🎉

Summary

Closing — measured improvement (~11% faster on PR-style ubuntu-only runs across 3+3 green runs) isn't worth shipping.

What was tried:

  • Custom vitest sequencer doing alphabetical round-robin sharding (vs hash-based default)
  • run-p test:init:* to parallelize fixture installs
  • Bonus: removed a real concurrency race in clone.test.ts (describe.concurrent + let execaMock reassigned in beforeEach)

The clone test concurrency bug surfaced during this exploration is real and worth a separate PR. It will be filed independently.


For us to review and ship your PR efficiently, please perform the following steps:

  • Open a bug/issue before writing your code 🧑‍💻. This ensures we can discuss the changes and get feedback from everyone that should be involved. If you`re fixing a typo or something that`s on fire 🔥 (e.g. incident related), you can skip this step.
  • Read the contribution guidelines 📖. This ensures your code follows our style guide and
    passes our tests.
  • Update or add tests (if any source code was changed or added) 🧪
  • Update or add documentation (if features were changed or added) 📝
  • Make sure the status checks below are successful ✅

A picture of a cute animal (not mandatory, but encouraged)

@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented May 8, 2026

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 63015ec2-7c51-467f-9c8d-2981df6e7bb5

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch vaibhavacharya/ci-speed-opt

Comment @coderabbitai help to get the list of available commands and usage tips.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 8, 2026

📊 Benchmark results

Comparing with 07fa4d1

  • Dependency count: 1,061 (no change)
  • Package size: 357 MB (no change)
  • Number of ts-expect-error directives: 355 (no change)

@VaibhavAcharya VaibhavAcharya changed the title perf(ci): balance integration shards using vitest duration cache perf(ci): round-robin shard sequencer + parallel test:init May 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant