Skip to content

ask 2: a structured per domain test outcome and human sign off, carrier not yet chosen #70

Description

@MendixMau

What Studio needs

A structured per domain test outcome, and a structured record that a person signed off, so the Build room can show "tested" and "checked by a person" as facts rather than blanks.

Today neither exists per domain. Studio's Build board renders those two columns with a "not recorded" glyph, deliberately distinct from "not yet", because a blank that reads as a pass is the failure this board exists to prevent.

Blast radius

Rating: needs care, and not ready for a PR. The carrier has not been chosen, and two of the candidates are gated.

Candidates and what each would disturb:

carrier problem
docs/report.json Required by gate-check.sh Stage 6. Additive optional fields on schema 1.x are the only safe option, and the requirement field already names BRD ids. A major bump to 2.0 makes Studio's reportParser.ts return null, so every domain silently loses its tested chip.
architecture/build-plan.md State column Closed set today: built, partial, not built, blocked.
docs/BUILD-LOG.md Parsed by status.sh, done-drift-check.sh and Studio's proof.ts. See ask 5.
design/ui-reviews/ui-review-*.html The look obligation's artifact, with a mandatory denominator. Replacing the requirement flips that obligation to PENDING or FAULT on every project that has reviews in the old shape.
.claude/loop/verify/<Module>/summary.tsv The journeys obligation's artifact.

Second risk: attaching outcomes per domain when a BRD only carries modules[] recreates the shared module overclaim described in ask 3.

Decision needed

  1. What a domain is for this purpose: a BRD id, a requirement id, or a module.
  2. The carrier. Additive optional fields on report.json 1.x rows, keyed by requirement, is the only candidate that changes no gate and keeps Studio's parser working.
  3. Whether human sign off lives in the toolkit at all. Studio already writes .mxtk/proof.json and may write only inside .mxtk/. If sign off stays there, the toolkit side may need nothing beyond an agreed file name that the LOOK row in ask 4 can point at.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions