Test that every documented command parses - #20
Merged
Merged
Conversation
SKILL.md, README.md and the help screen all spell catchup invocations out by hand, so a renamed flag can leave them teaching a command the binary rejects. The new test lifts every documented `catchup ...` line out of the three and runs it through the real argument parser, naming the document, the line and the parser's own error when one fails. It also gates the SKILL.md frontmatter that install-skill depends on: the name matches the directory each copy is written to, and the description stays inside the 1024-character budget with no angle bracket tokens a validator would read as markup.
README.md and the help screen are read by people, who try another spelling when one is rejected. SKILL.md is the copy that fails quietly: an agent following a stale line reports that catchup cannot do the thing and stops. Binding all three tied the test to two documents whose drift a reader corrects anyway, so the scan now covers the one that nobody is watching. The extractor stays as it was — SKILL.md is Markdown too — and so does the test that pins it. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01K1bnmAA2o7tPADLVLD46cA
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
SKILL.md, README.md and the help screen each spell catchup invocations out by hand, so a renamed or removed flag can leave them teaching a command the binary rejects, and SKILL.md is what an agent reads before it ever runs catchup.
One new test file lifts every documented
catchup …line out of all three and runs it through the real argument parser. A rejection names the document, the line, the command as written and the parser's own error. Each document carries a floor on how many invocations must be found, so a scanner that matches nothing fails rather than passes.It also gates the SKILL.md frontmatter that install-skill depends on: the name matches the directory each copy is written to, and the description stays inside the 1024-character budget with no angle-bracket tokens a validator would read as markup.
Test code only. No production file changed, no new dependency.