Skip to content

llm usage stats collect fix + set trajectory failure reason#42

Merged
mayinghan merged 3 commits intomainfrom
usage-accumulation-fix
Aug 9, 2025
Merged

llm usage stats collect fix + set trajectory failure reason#42
mayinghan merged 3 commits intomainfrom
usage-accumulation-fix

Conversation

@mayinghan
Copy link
Copy Markdown
Collaborator

@mayinghan mayinghan commented Aug 8, 2025

  1. keep the llm usage stats properly even for rollouts throwing exception in the middle.
  2. set trajectory failure and reason when rollout stopped at a llm response where we expect a tool call but there isnt one (the env is still in progress)

@mayinghan mayinghan changed the title keep intermediate llm usage stats even for failure trajectories llm usage stats collect fix + set trajectory failure reason Aug 9, 2025
@mayinghan mayinghan merged commit 1a1046e into main Aug 9, 2025
7 checks passed
@mayinghan mayinghan deleted the usage-accumulation-fix branch August 9, 2025 20:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant