Skip to content

Improve agent workload simulation and metrics - #24

Merged
jamesdborin merged 1 commit into
mainfrom
agent/improve-agent-workload-simulation
Aug 18, 2026
Merged

Improve agent workload simulation and metrics#24
jamesdborin merged 1 commit into
mainfrom
agent/improve-agent-workload-simulation

Conversation

@jamesdborin

Copy link
Copy Markdown
Contributor

Summary

  • tag agent requests with a persistent per-agent UUID by default, with opt-out and deterministic prefix support
  • treat model output as opaque assistant state and append a valid synthetic tool-call/result pair
  • add --ignore-eos for exact output-length workloads
  • report completed-agent end-to-end p50, p90, and p99 latency in console and CSV output
  • document the updated agent-mode behavior

Why

Agent-mode benchmarks need stable session affinity without assuming that random model output contains valid tool calls. They also need exact output-length generation and full-agent lifetime percentiles to characterize stateful multi-turn workloads accurately.

Validation

  • cargo fmt --check
  • cargo test (18 tests passed)
  • cargo clippy --all-targets -- -D warnings attempted; blocked by two pre-existing warnings in untouched rust/src/cli.rs (large_enum_variant and manual_unwrap_or)

@jamesdborin
jamesdborin merged commit a78d6b1 into main Aug 18, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant