Skip to content

fix(evals): ground audit disclosure and verify CI bootstrap - #190

Merged
vriesd merged 17 commits into
mainfrom
fix/inspection-audit-disclosure
Oct 9, 2026
Merged

vriesd merged 17 commits into
mainfrom
fix/inspection-audit-disclosure

Conversation

@vriesd

@vriesd vriesd commented Oct 9, 2026 •

Copy link
Copy Markdown
Contributor

Truthful inspection reports were rejected when they copied canonical nonzero observations, used coordinated failure prose, or labeled results Audit:. The checker now parses owned current statements into one shared subject model, reuses typed observations bound to the native failed gate, and validates declared exit/host fields independently of subject spelling or field order. Quotes, examples, hypothetical failures and contradictory metadata do not supply disclosure evidence.

The workflow-lint job also failed before linting because Docker Hub requests timed out or hit anonymous pull limits. CI now downloads the same actionlint 1.7.12 release, verifies its pinned checksum before execution, and requires ShellCheck and Pyflakes integrations.

Validation: 4,043 tests passed, 20 existing skips, zero failures. Independent review passed 363 public controls, 506 regression tests, the original retained-input replay, and seven real CI bootstrap probes. The package archive and full manifest still match the approved bytes. Tests precede fixes in history. Paid qualification and release evidence remain pending; stopped campaign reports are unchanged.

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Oct 9, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-10-09T21:43:23.531186Z f754c51 PR opened
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: f754c51d43

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread evals/scenarios.ts Outdated
@vriesd vriesd changed the title fix(evals): bind audit failure disclosures to native evidence fix(evals): ground audit disclosure and verify CI bootstrap Oct 9, 2026
@vriesd
vriesd merged commit a3866a6 into main Oct 9, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants