Repository navigation
Conversation
This was referenced Oct 9, 2026
Add a static inventory of the NASim SDL and task evidence requirements, their native availability at NetworkAttackSimulator 7c732bc, the capture chain at dev 0272949, the equivalence data needs, and a spec-only regression-fixture design, plus its Decisions nav entry. Docs only, as the 2026-08-13 hold on #87 permits: no contract, schema, manifest, runtime, package, CLI, ledger, or test change. Refs #87
doublewhy
force-pushed
the
85-cyborg-evidence-capture-inventory
branch
from
October 9, 2026 14:45
fbbea80 to
3e264fd
Compare
Add a static inventory of the CAGE-2 SDL and task evidence requirements, their native availability at cage-challenge-2 26ce1c1, the capture chain at dev 0272949 (researcher and reproduce paths), the equivalence data needs, and a spec-only regression-fixture design, plus its Decisions nav entry. Docs only, as the 2026-08-13 hold on #85 permits: no contract, schema, manifest, runtime, package, CLI, ledger, or test change. Refs #85
doublewhy
force-pushed
the
85-cyborg-evidence-capture-inventory
branch
from
October 9, 2026 14:53
3e264fd to
ac496e5
Compare
doublewhy
marked this pull request as ready for review
October 9, 2026 15:15
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds
docs/decisions/cyborg-evidence-capture-inventory.md, the static inventory and regression-fixture design that the 2026-08-13 hold on #85 permits, plus one Decisions nav line inmkdocs.yml. It follows the format set by #98 (NASim). Atdev0272949the page records:operational-service-state, theoperational-service-availableproposition that cites it, andsource-ledger:reward-componentsas both the task metric's evidence and its observation requirement. Each has file and line in the scenario SDL and the packagedexamples/cage2-researchcopies;26ce1c1and its class, citing the existingmapping/cage2-source-ledger.jsonlrows and loss disclosures;reproducecommand, with the manifest declarations and the emitted files and fields;tools/verify_cyborg_qualification.py.Findings worth a look, all recorded as facts without changing anything:
reproduce --phase runpath does not go through the CLI evidence gate. Its run artifact setssatisfies_refstooperational-service-stateandsource-ledger:reward-components(reproduction.pyL1790–1804) beforevalidate_experiment_run_against_task()runs. The researchervalidateandruncommands exit3for the same task.EnvironmentController.determine_donereturnsFalseandSimulationControllerdoes not override it. Thesource-terminalcause therefore cannot occur, and every episode ends at the logical-step limit.OTServiceprocess state that ledger row 19 keeps hidden.action-costcomponentsource-ledger:reward-objectives(driver.pyL236–247), which is ledger row 45, whose selector is Red'sHybridImpactPwnRewardCalculator.calculate_reward. The evaluator copies that tag into each action-cost record (evaluator.pyL763–771), so after a costed Blue action such asRestorethe cumulative action-cost measure cites row 45 records. The CI qualification smoke asserts the tag (tools/verify_cyborg_qualification.pyL300–306). The packaged Blue policy selectsSleep, which costs 0, so packaged runs emit no action-cost measure.The hold on #85 remains in force. The naming decision, OpenRAE/rae#1023, is still open; the other resume condition, OpenRAE/rae#1112, closed on 2026-09-07.
Stacking
All four inventory PRs add one line to the same
mkdocs.ymlnav list, so they are stacked. This branch contains #98's commitd89aa60(NASim, Refs #87) followed by its own commitac496e5; review onlyac496e5. Merge #98 first, and this branch will then be rebased ontodev.CI note
SonarCloud fails before any analysis. The scanner's first API call returns
HTTP 403 Forbiddenand its message says to checkSONAR_TOKEN(CI run 37947519563, SonarCloud job). PR Gate then fails, because it requires SonarCloud to succeed on same-repository PRs. The same 403 occurs ondev0272949in workflow_dispatch run 37919671796; the last passing SonarCloud job ondevwas in run 32215409423 on 2026-08-19. The token failure is tracked in #102. Every other job passes: Fast checks, Policy, Tool tests, Typecheck, Tests, Distributions, Docs, CodeQL, Lint PR title, and GitGuardian.Requirement UIDs
Related Issues
Refs #85
ADR Impact
adr-index.yamlis untouched.Changes
docs/decisions/cyborg-evidence-capture-inventory.md(new): the inventory and fixture design. Source references are GitHub links pinned to adapters0272949, cage-challenge-226ce1c1, and RAESv3.3.0(fb8a23a), because the Read the Docs site returns 404.mkdocs.yml: one nav entry under Decisions, after the CybORG/CAGE-2 downstream environment-pack guardrails.mapping/ledgers are cited, not edited.ac496e5, replacesfbbea80and changes only the page. It was pushed as3e264fd, and docs(nasim): inventory evidence-capture requirements #98's revision then restacked it ontod89aa60unchanged (git range-diffreports3e264fd = ac496e5). The native lane now describes the CI qualification seam and F5 extends it. Section 3, D4, the tensions paragraph, and F2 now record the row 45 action-cost tag. The component-measure,satisfies_refs, and RAES-release sentences are now exact. The revision adds 10 pinned references and re-anchors one.Test Plan
All commands ran in the worktree at head
ac496e5on 2026-10-09.uv tool run --from 'nox[uv]==2026.4.10' nox -f noxfile.py -s docs: the strict MkDocs build passed. The page's rendered content has 6 tables and 112 GitHub links, 107 of them pinned to commits. The other 5 link to issues or pull requests: fix(cyborg): reconcile SDL evidence requirements, simulator capture, and backend manifest #85, runtime: reject backends whose capture manifests do not satisfy scenario requirements rae#1112, chore(naming): rename RAES to RAE across repository surfaces rae#1023, and feat(runtime): enforce capture admission and evidence proof rae#1239 twice. The page has no unresolved reference-style link. Its relative links resolve to the NASim inventory, the claim guardrails, and four CybORG decision records.nox -s hygiene(same invocation): passed.nox -s lint: passed.nox -s policy -- --skip-requirement --base-rev origin/dev: repo policy, ADR immutability, project services, and identity policy OK; requirement governance skipped, as CI does for a branch name without a UID.nox -s tool-tests: passed (53 tests).uv buildat this head and atorigin/dev: the wheels are byte-identical (SHA-256068871d1866b944cf65a695f5c49c1a6c8705b334aea565a54b19819d341ebc6) and the 193 sdist members are identical in names and bytes.26ce1c1through the GitHub API; those listed inqualification.jsonselected_filesmatched their recorded SHA-256.CybORG.py,Simulator/SimulationController.py, andShared/Actions/Action.pyare not in that list and were read at the commit. No native CybORG episode was run locally.noxfile.pyL487–488 runstools/verify_cyborg_qualification.pyin thecyborgtest environment. The Tests job of CI run 37947519563 logsCybORG qualification: OK.git tag --contains 68d25df(the #1239 merge commit) listsv4.0.0,v4.1.0,v5.0.0,v6.0.0, andv6.0.1. PyPI hasraes4.1.0 (2026-09-13), 5.0.0, and 6.0.1 but no 4.0.0 or 6.0.0, so 4.1.0 is the first published release that includes it.typecheck,tests, anddistributions. The diff touches only this page andmkdocs.yml; no type check, test, or distribution step reads either file, and the built wheel and sdist are unchanged. CI runs all three.Ground Control Checks
Traceability
Checklist
CHANGELOG.mdedit.Documentation
New decision record listed in the MkDocs Decisions nav.