Skip to content

feat(yield): add coding-agent workflow evaluation - #276

Merged
bigboateng merged 1 commit into
mainfrom
feat/yield-agent-evals
Aug 1, 2026
Merged

feat(yield): add coding-agent workflow evaluation#276
bigboateng merged 1 commit into
mainfrom
feat/yield-agent-evals

Conversation

@bigboateng

Copy link
Copy Markdown
Contributor

Summary

  • add a real Codex two-arm evaluation for one owned release workflow
  • compare long-skill and thin-skill-plus-Yield traces across six branch outcomes
  • verify command evidence, requirements, agent tasks, ask-user responses, terminal status, and zero rejected responses
  • fix documented positional-first yskill commands and refresh source-bound deterministic results

Claim boundary

This proves matching workflow control for the declared owned cases. It does not score domain judgment, claim Yield is better than prose, or generalize to every skill. Raw transcripts remain ignored; the compact source-bound result is checked in.

Test plan

  • go test ./...
  • go vet ./...
  • cd evals && npm test
  • cd evals && npm run test:agent
  • 12 real Codex runs: 6/6 paired cases passed with 0 rejected Yield responses

Disclosure-Reviewed: reviewed — public-safe only, private facet kept out of this commit
@bigboateng
bigboateng merged commit 50fdb72 into main Aug 1, 2026
5 checks passed
@bigboateng
bigboateng deleted the feat/yield-agent-evals branch August 1, 2026 19:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant