DeltaWire preflight v6: preinstalled Gemini agent boundary - #115
DeltaWire preflight v6: preinstalled Gemini agent boundary#115bigboateng wants to merge 11 commits into
Conversation
V6 paid probe evidence — PASSThe single authorized D1-only One-shot identity
Gates
Usage diagnostics
These are reported separately. No cost or savings claim is made. Frozen validation limitationThe full DeltaWire validation passes. The frozen v6-only suite now reaches a pre-existing negative test that assumes {
"READY_FOR_72": false,
"pair_launched": false,
"six_run_canary_started": false,
"full_run_started": false,
"pair_requires_explicit_review": true
}The pair remains unauthorized unless the user later says exactly |
Evidence-head CI conclusions
Both v6 failures are identical: the frozen negative test invokes No frozen input was modified to repair or hide this. The live release was independently reverified successfully and the limitation is retained in |
Frozen pair attempt: stopped after D1 fidelity gateEvidence commit: Exactly one live pair command was invoked. D1 completed with no Harbor exception, reward 1, and exact records 1–500. Environment, artifact transport, model/agent identity, skill activation, DeltaWire validate/render/check, retained artifacts, and both contract checks passed. The treatment receipt failed solely because structured pre-activation D1 usage: input 1,227,632; output 11,590; input+output 1,239,222; cache 979,337; Harbor-reported cost $0.8315374; wall time 245.613068 s. Cache is reported separately. Full DeltaWire validation passed. The unchanged v6-only workflow is expected to retain the documented |
Evidence-head CIEvidence head:
Both red runs pass evidence locks, environment, artifact, setup, trial normalization, shell-observation, and treatment-use tests before failing at the unchanged |
|
Reusable v6 infrastructure and the terminal evidence lock merged cleanly in PR #117 at |
Summary
This experiment PR establishes the DeltaWire preflight v6 deterministic agent boundary and stops before any paid model call.
It preserves v1-v5 evidence, preinstalls and pins Gemini CLI in the task image, replaces Harbor's dynamic Gemini installation with a local verification-only custom agent, retains all three credential-free conformance trials, and freezes the resulting execution manifest.
This PR is intentionally an experiment/evidence branch. Raw jobs, logs, configs, locks, results, and receipts are retained here for review. A later clean integration PR should project only reusable implementation and compact evidence onto
main.ZCA slices
approve the paid v6 probe; the pair requires a second exact authorization phrase.The immediate value is that a future paid failure can be attributed to treatment behavior rather than npm installation or agent bootstrap.
Why v6 exists
The v5 paid probe failed before agent execution because Harbor's official
GeminiCli.install()dynamically ran apt/NVM/npm setup and timed out. V5 therefore established environment/artifact transport but did not test the model, DeltaWire lifecycle, or semantic output.V6 keeps Harbor 0.20.0's official Gemini execution behavior while overriding only:
name()for an explicit custom-agent identity;install()for local path, version, package, and image checks.Official run, authentication, settings, skill, prompt, trajectory, ATIF, token, cost, and resume behavior remain inherited.
Changes
preinstalled-gemini-cli-v1with structural tests proving onlynameandinstallare overridden.preinstalled-gemini-setup-receipt.v1generation and validation.range-large-v6, probe/pair tasks, contracts, schema, artifact gates, release gates, and a runner exposing onlyprobe-v6andpair.No-model conformance results
Exactly three credential-free Harbor 0.20.0 install-only trials completed:
All three produced identical canonical setup-receipt bytes:
a88d221e573265997797dcad31136aec0ed74a5bd37e50887595e5ea85cfa0d1Harbor 0.20.0 disables verifier collect hooks under
--install-only; it still automatically retained/logs/artifacts, including the setup receipt. The paid path separately requires the main collect hook, environment receipt, and successful artifact manifest.Frozen identity
d889f7ebdb73044f0bed1abefbdc294cda203843a4202620c388a3abce5e63d740986e366209b76eea5a4b4073604cd940f3f016cae390ae214b48f281fd30ed4581eedd4f99bc7a6488387dbd1c4598be003aabc302ab9d37fe3d2c5eaab0d6a9263db6fad44f45sha256:589fce58d7ddf09910876afe0198bcee0086a840af6de7c08515bbce3e8367a7e5198d15000e093a2a28e57ad4a093dde8f66bcab21462549ddf9114064c25f40.20.0google/gemini-3.1-pro-previewagents.preinstalled_gemini_cli:PreinstalledGeminiCliThe frozen VM dry-run verified every lock/hash and resolved exactly one D1 trial. Both live result roots were empty.
Validation
Review focus
Please review whether:
Authorization and readiness
No paid probe or pair has run. This PR does not authorize either.
{ "READY_FOR_72": false, "probe_authorized": false, "probe_launched": false, "pair_launched": false, "six_run_canary_started": false, "full_run_started": false }A future passing D1 probe would prove only one end-to-end treatment path. It would not establish savings, cost effect, family-wide behavior, statistical significance, or readiness for 72 runs.
Current terminal experiment state (supersedes the earlier pre-live readiness text)
The paid v6 D1 probe passed at evidence commit
0dad5c01684b337f8a1bf42f17141f4789c95740and produced content-addressedprobe-release.v4516be1dff108126fa15d6108b2720b80ed7fa39615a6698e52cd22270df6ac5e.The separately authorized frozen
range-large/r1pair attempt is now terminal at evidence commit273e977c. D1 completed with exact semantic output and passed setup, environment, artifact, activation, lifecycle, retained-artifact, and contract gates. It failed treatment fidelity only because the structured trajectory did not execute the mandatory pre-activationgemini skills listdiscovery call. The frozen runner therefore stopped before B0. No causal comparison or token-effect claim exists, and no rerun is permitted.b3a68ff5-3215-4d29-a698-2b364ac261b9attempted_failedmissing_structured_pre_activation_discoveryfrozen_negative_test_not_post_release_safefixture failure{ "READY_FOR_72": false, "pair_attempt_consumed": true, "pair_complete": false, "pair_valid": false, "six_run_canary_started": false, "full_run_started": false }Superseded provenance
Reusable v6 runtime infrastructure and the Git-object-backed terminal evidence lock were cleanly integrated by PR #117, merge commit
82a7963bdd98ca41435e756fb4212b3b37b19420. This PR remains the immutable raw experiment provenance and is closed without merge or rebase.