From 2b13f57dd408588828f9525d8558df1808385068 Mon Sep 17 00:00:00 2001 From: r Date: Mon, 21 Sep 2026 11:32:27 +0000 Subject: [PATCH 1/4] docs(testing): Windows full test-run prompt Adds docs/windows-test-run.md: a paste-able, unattended Claude Code prompt for a Git Bash machine. Covers the CI guard scripts, both fixture suites, 27 Windows-relevant fixtures with their subjects, the committed inputs (fixtures/app-analysis, page-fidelity mocks, html-to-md capture) run directly, and a field run on a scratch copy of a real project including the two-tree and toolkit.env precedence probes. Produces one results file, facts only. CHANGELOG line added in the same commit. Co-Authored-By: Claude Fable 5.1 Claude-Session: https://claude.ai/code/session_01VJgWP5vEoAsNsJYqCDMGNw --- CHANGELOG.md | 1 + docs/windows-test-run.md | 216 +++++++++++++++++++++++++++++++++++++++ 2 files changed, 217 insertions(+) create mode 100644 docs/windows-test-run.md diff --git a/CHANGELOG.md b/CHANGELOG.md index 51a77f7..9a749da 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -16,6 +16,7 @@ three commits past it), and a bug report can name a release instead of a sha nob Sections dated before 2026-09-19 predate the cycle and stay as they are. ## Unreleased +- docs(testing): **Windows full test-run prompt.** `docs/windows-test-run.md` — a paste-able, unattended Claude Code prompt for a Git Bash machine: guards, both fixture suites, 27 Windows-relevant fixtures with their subjects, the committed inputs (`fixtures/app-analysis`, page-fidelity mocks, html-to-md capture) run directly, and a field run on a scratch copy of a real project incl. the two-tree and toolkit.env probes; one results file, facts only — Maurits Visser - learn(skills): **`learned-mdl-preflight.md` trimmed 7,173 → 5,311 words; `learned-stylegallery.md` demoted from baseline to on-demand (baseline pack 79,993 → 72,001 words).** Per the 2026-09-17 A/B/C freshness run: rows 2/7/10 cut to one-line RESOLVED cells with a pointer to the retest record; workflow rows 18–20 and the duplicate JUMP TO row 24 collapsed into one row 18 that routes to `learned-workflow-patterns.md` (cross-references in workflow-patterns, module-brief and the bug ledger renumbered); "MDL gotchas" cut to what the generated `CLAUDE.md` and `learned-microflow-patterns.md` do not already say; rows 23–24 (DesignProperties) rejoined to the STOP table from below a stray rule. STOP table itself unchanged — arm C kept it and matched arm B on every routing row — MendixMau - learn(bug-logs): **`BUG-DRAFT-stale-init-claude-md-declare-object`** — a `CLAUDE.md` written by a v0.16-era `mxcli init` still lists `DECLARE $Entity Module.Entity;` as a supported statement; v0.22 `check` rejects it (MDL043/CE0053, golden capture in the entry). v0.22 `init --tool claude` no longer emits the row, but `init` overwrites instead of refreshing and stamps no version into the file, so nothing flags an old scaffold. The sigil parameter form is accepted — the freshness report's first draft over-claimed that and is corrected in the same commit. Upstream ask (paste-ready in the entry): version stamp, `init --check`, refresh-only-generated-blocks. Toolkit follow-up proposed: a report-only warn in `sync-project.sh` and a strip rule in `bootstrap-project.md` — MendixMau - process(skill freshness): **A/B/C baseline of the four baseline-tier skills against mxcli v0.22.0 — three still change validator-blind behaviour, one does not.** `process/skill-freshness-2026-09-17.md`: 33 fresh Sonnet drafting runs (arm A no skill, B full text, C pure-deletion ablation; 3 reps) on a scratch copy of the TCX graph PoC, scored by `mxcli check`, `check-page-shell.sh`, `page-fidelity.js`, STOP-row greps and two rubric graders. `learned-mdl-preflight.md`: keep the STOP table, cut the retired-incident narratives and "MDL gotchas", move workflow rows 18–20 to `learned-workflow-patterns.md` (arm C at −37% words matched B on every routing row). `learned-microflow-patterns.md`: keep whole — arm C lost the Dto-section hint and 2/3 drafts regressed to declared object variables. `ui-preflight-pages.md`: keep; two sections are cut candidates (arm C indistinguishable from B: 3/3 top-bar layout, 3/3 H1 vs A 0/3). `learned-stylegallery.md`: no arm-B advantage on the add-a-gallery-page task (B wired the page 1/3, A 3/3) — demote that trigger to situational. Also found: the generated project `CLAUDE.md` teaches `DECLARE $Var Module.Entity;`, rejected by v0.22 (nine drafts across all arms hit it); two bundled skills contradict STOP row 6; the run cost 4.3M subagent tokens against a 0.5M estimate. Follow-up PRs listed in the report, none opened — MendixMau diff --git a/docs/windows-test-run.md b/docs/windows-test-run.md new file mode 100644 index 0000000..ba64dda --- /dev/null +++ b/docs/windows-test-run.md @@ -0,0 +1,216 @@ +# Windows full test-run — paste-able prompt + +**Applies to:** the toolkit itself, on a Windows machine with Git Bash (MSYS) +**Purpose:** one prompt you paste into a fresh Claude Code (or any agent) session on Windows. +The session clones the toolkit, runs every guard, both fixture suites, the Windows-specific +fixtures with their correct subjects, and a field run on a **scratch copy** of a real Mendix +project. It writes one results file and stops. You read the file, not the transcript. + +Why this exists: `CLAUDE.md` → "Shipping an instrument" rule 3 ("Both platforms") and rule 2 +("Both layouts") are asserted by fixtures that were written on macOS and Linux. Nobody has run +the whole set on the platform they claim to cover. This is that run. + +**Before you paste.** Fill in the two placeholders in the prompt: + +| Placeholder | What to put there | +|---|---| +| `` | An existing Mendix project on this machine that uses the toolkit (has `.mpr`, `./mxcli`, `mdlsource/`). It is copied; the original is never touched. Leave as-is to skip the field run. | +| `` | `master`, a tag (`v2026.09.22`), or a branch. Default `master`. | + +Expected wall time: 20–40 minutes, most of it `bin/doctor.sh --install` and the wave2 suite. + +--- + +## The prompt (copy from here to the end of the file) + +````text +You are running the full Windows test run of the mxcli-project-toolkit. Work unattended: +do not ask me anything, do not stop for approval, do not open a browser tab. If a step +fails, record it and continue with the next step. When every step has run, write the +results file and stop. + +RULES +- Platform is Windows with Git Bash (MSYS). Run everything with `bash