feat(bench-kit): zone-aware update + agent-tool profile in init - #31
Merged
psmyrdek merged 1 commit intoAug 14, 2026
Merged
Conversation
- init resolves the agent tool (--tool flag > manifest on repair > interactive pick pre-filled by marker detection > claude-code) and materializes template skills under the profile's skill root (.claude/skills, .agents/skills, ...); the chosen tool is recorded in instance.json so update knows where to propose skill diffs - update works zone by zone: .bench-kit/ replaced wholesale (staged swap, manifest survives version-bumped), workflows and skills synced into the working tree as an uncommitted proposal reviewed via git diff, company content never touched; clean-worktree gate keeps the proposal reviewable - template skill source auto-detects the planned .agents/skills migration Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
psmyrdek
added a commit
that referenced
this pull request
Aug 14, 2026
…#32) - init resolves the agent tool (--tool flag > manifest on repair > interactive pick pre-filled by marker detection > claude-code) and materializes template skills under the profile's skill root (.claude/skills, .agents/skills, ...); the chosen tool is recorded in instance.json so update knows where to propose skill diffs - update works zone by zone: .bench-kit/ replaced wholesale (staged swap, manifest survives version-bumped), workflows and skills synced into the working tree as an uncommitted proposal reviewed via git diff, company content never touched; clean-worktree gate keeps the proposal reviewable - template skill source auto-detects the planned .agents/skills migration Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Implements the two remaining bench-kit CLI pieces (points 1–2 of the current plan; design contract: DESIGN.md in 10x-benchmark-webinar / template README zone contracts).
Stacked on #30 (init copies workflows) — merge that first, then retarget/merge this into master.
init: agent-tool recognition
--toolflag → manifesttoolon repair → interactive@clackpick pre-filled bylib/tool-detect.tsmarker detection → detection result →claude-code(also the--yespath)..claude/skills/,.agents/skills/,.cursor/skills/, …) instead of hard-coding the template's location; no empty.claude/shell is left behind..bench-kit/instance.jsonsoupdateknows where to propose skill diffs. Repair preserves the manifest (tool,initializedAt, detected base repo).update: zone-aware template upgrade
Mirrors the manual adoption procedure done four times (0.3.0, 0.4.0, 0.4.1, 0.4.2):
.bench-kit/updatedAt).github/workflows/git diff; company-only skills never deletedtasks/,evaluation-pool/,bench.config.yamldirty_worktree) so the proposal diff stays reviewable;up to dateno-op when versions match;not_an_instanceguard.bench validate, which owns schema-compatibility checking per the design..agents/skills/migration (falls back to.claude/skills/).Testing
tests/bench-kit-command.test.ts(init tool placement, repair preservation, all update zones + guards); full suite 503 green, typecheck + lint clean.captureStreams(restore ran after the next capture's patch, leaking output to real stdout).init --template-version v0.3.0 --tool codex→ skills under.agents/skills/; customized a template skill + added a company skill →updateto 0.4.2: runtime replaced (new leaderboard files in), skill customization shown as reviewable diff, company skill preserved, manifest bumped, dirty guard verified.🤖 Generated with Claude Code