Skip to content

Add sync-automatic-tools prompt#621

Merged
rajbos merged 1 commit intomainfrom
rajbos/add-auto-tools-review-prompt
Apr 18, 2026
Merged

Add sync-automatic-tools prompt#621
rajbos merged 1 commit intomainfrom
rajbos/add-auto-tools-review-prompt

Conversation

@rajbos
Copy link
Copy Markdown
Owner

@rajbos rajbos commented Apr 18, 2026

Adds .github/prompts/sync-automatic-tools.prompt.md — an agent prompt that audits src/automaticTools.json against src/toolNames.json and corrects the automatic vs intentional tool classification.

Why

The automaticTools.json list drives fluency/maturity scoring — tools in it are excluded from the user's intentional tool usage score. As new tools are added via sync-toolnames, the auto classification can drift.

What the prompt does

  • Loads toolNames.json (all known tools) and automaticTools.json (current auto set)
  • Applies 4 rules in priority order:
    1. MCP tools (mcp_*, mcp., mcp__) → always intentional
    2. Write/execute/fetch toolsintentional
    3. Read/search/list/inspect toolsautomatic
    4. Single-word heuristic for unknowns (read-like = auto, write-like = intentional)
  • Adds missing automatic tools and removes any that shouldn't be there
  • Prints a summary of changes

Relationship to existing prompts

sync-toolnames.prompt.md already classifies new tools when they're first added. This prompt is for bulk-reviewing the full list to fix any historical misclassifications or tools that slipped through.

Adds .github/prompts/sync-automatic-tools.prompt.md — an agent prompt
that audits automaticTools.json against toolNames.json and ensures
every tool is classified correctly as automatic or intentional.

Key classification rules encoded in the prompt:
- MCP tools (mcp_*, mcp., mcp__) are always intentional
- Write/edit/execute/fetch tools are intentional
- Read/search/list/inspect tools are automatic
- Single-word heuristic for unknown tools

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@rajbos rajbos enabled auto-merge April 18, 2026 09:50
@rajbos rajbos merged commit c9f4619 into main Apr 18, 2026
16 checks passed
@rajbos rajbos deleted the rajbos/add-auto-tools-review-prompt branch April 18, 2026 09:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant