[Chore] Turn CodeRabbit automatic review off and request it by comment - #455
Conversation
The WordPress organisation's CodeRabbit trial ended on 2026-09-11 and the free open-source plan includes about one review per hour for the whole organisation. With automatic review on, every PR marked ready spends that slot at a moment nobody controls, and a PR that hits the limit is lost: CodeRabbit marks the commit as reviewed and refuses a later request for it. With automatic review off, `@coderabbitai review` can be repeated until it runs. The three documents that said CodeRabbit reviews every non-draft PR now say how to request one and what to do when it is rate limited. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_018WiWyxXHdciZLQ8Q1hubdv
|
Important Review skippedAuto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Advanced Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
@coderabbitai review |
|
Why
The WordPress organisation's CodeRabbit trial ended on 2026-09-11 (confirmed by the org admin on Slack). The free open-source plan includes about one review per hour for the whole organisation, on a rolling window: today it reset after 3, 10, 19, 57, 30 and 10 minutes on consecutive PRs. With automatic review on, every PR marked ready spends that slot at a moment nobody controls, and a PR that hits the limit is lost: CodeRabbit marks the commit as reviewed and refuses a later
@coderabbitai review("does not re-review already reviewed commits. This command is applicable only when automatic reviews are paused"). Of the last twelve PRs, ten got "Review limit reached" instead of a review.What changes
auto_review.enabled: falsein.coderabbit.yaml. The author asks for a review with@coderabbitai reviewonce their own pass is done and the head commit is the one to review; if it is rate limited, they wait the stated time and ask once more, and if that is refused too they record the review as not run. A refused manual request does not burn the commit, so it can be repeated.draftsandbase_branchesgo with it: they only govern the automatic trigger. No path or title filters: with a manual trigger the author decides which PRs get the slot..github/instructions/code-review.instructions.md,AGENTS.mdandCONTRIBUTING.mdsaid CodeRabbit reviews every non-draft PR; they now say how to request one.How to test this
Platforms: any. Config and docs only.
Starting state: this PR, open and non-draft.
@coderabbitai review. Expected: either a review starts ("Review in progress") or the bot answers "Review rate limited" with a wait time, without the "already reviewed commits" note.grep -rn "every non-draft" --include='*.md' .from the repository root: the only hits are inTESTING.mdandAGENTS.mdabout the journeys workflow, none about CodeRabbit.What must not have happened: no other key in
.coderabbit.yamlchanged (git diff trunk -- .coderabbit.yamlshows only the header comment and theauto_reviewblock).Risks and limitations
The slot is shared with every other repository in the WordPress organisation that installs CodeRabbit, so a manual request can still be refused. Nothing in this repository can change that; the docs say what to do when it happens. Whether a manual request on a PR that was never auto-reviewed behaves as the docs say is verified on this PR itself, see the review outcome below.
Related
Follow-up to #400.
Design decisions and alternatives considered
Keep automatic review and filter by PR title or label (
ignore_title_keywords,labels): rejected. It still spends the slot at an uncontrolled moment, and a code PR that hits the limit is still lost. Ask the bot first with@coderabbitai rate limit: rejected, on #441 it answered "Reviews are available now" and a review seven minutes later was refused.Review outcome (required — see AGENTS.md)
@coderabbitai reviewrequest answered "Review limit reached, next in 49 minutes" without the "already reviewed commits" note, and the PR was merged before the window rather than spending the slot on a config-and-docs change. Author's pass: config and docs only, lint and both CI suites green.🤖 Generated with Claude Code
https://claude.ai/code/session_018WiWyxXHdciZLQ8Q1hubdv