Skip to content

fix: catch verification checklist query leaks - #7

Draft
kkkhs wants to merge 1 commit into
krapcys1-maker:masterfrom
kkkhs:agent/query-leak-verification-criteria
Draft

fix: catch verification checklist query leaks#7
kkkhs wants to merge 1 commit into
krapcys1-maker:masterfrom
kkkhs:agent/query-leak-verification-criteria

Conversation

@kkkhs

@kkkhs kkkhs commented Aug 30, 2026

Copy link
Copy Markdown

What this changes

The audit suspect pass now catches the two recorded verification/checklist leaks from cmtf8woru, including the keyword-extracted variant.

Why

Fixes #6. The previous structural heuristic missed these because they had no terminal punctuation, no leading imperative, and only used generic verification / candidate words without one of the existing artifact compounds.


Checks

  • pnpm typecheck clean
  • pnpm test passes (Postgres + Redis up — see README for what runs without them)

pnpm test was attempted on this devbox, but Docker/Postgres/Redis are not available here. The no-services run still reached 488 passing tests, and the targeted audit test passed.

If this touches an evidence decision

Anything that changes what earns CODE_VERIFIED, what a verdict may say, what
reaches memory, or what counts as a relevant source:

  • There is a test that fails when this change is reverted

tests/audit-query-leak.test.ts adds both real leaked strings from #6 to mustFlag; before the heuristic change, those two cases failed.

If this makes the system claim something new

  • The claim is checked in code, not only in a prompt
  • Failing to establish it produces a distinct outcome, not a silent downgrade

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

The query-leak audit misses 2 of 12 known leaked strings

1 participant