Initial commit for adapters for langfuse and HF#11

Closed

benjibc wants to merge 327 commits intomainfrom

This pull request is big! We're only showing the most recent 250 commits

Commits on Jun 13, 2025

Commits on Jun 16, 2025

Merge pull request #84 from fw-ai-external/codex/remove-jsonl_reward_eval_command
benjibc
authored

Commits on Jun 20, 2025

batch mode example and generate completions for batch mode
benjibc
committed

Commits on Jun 22, 2025

Commits on Jun 26, 2025

Commits on Jun 27, 2025

mcp part 2
benjibc
committed

Commits on Jun 28, 2025

part 3
benjibc
committed
fix tests
benjibc
committed

Commits on Jun 29, 2025

Commits on Jul 2, 2025

Adding new toy taxi example

derek@fireworks.ai
authored and
derek@fireworks.ai
committed
formatting
xzrderek
committed
Removing unused function
xzrderek
committed
removing unnecessary run_simulation_server file for now. may revisit
xzrderek
committed
Final update to README
xzrderek
committed
Merge pull request #103 from fw-ai-external/derekx/taxi_mcp
xzrderek
authored

Commits on Jul 3, 2025

Clean up frozen lake and taxi examples
benjibc
committed

Commits on Jul 6, 2025

Commits on Jul 8, 2025

Commits on Jul 9, 2025

Commits on Jul 12, 2025

Commits on Jul 15, 2025

Commits on Jul 16, 2025

Commits on Jul 18, 2025

Tau2 Environment Setup (#12)
xzrderek
authored

Commits on Jul 21, 2025

Commits on Jul 23, 2025

Commits on Jul 24, 2025

[Tau2-Bench] Eval / Natural Language Assertion (#37)
xzrderek
authored
add cliff walking example
ershang-fireworks
committed
fix test
ershang-fireworks
committed
fix walk cliff test
ershang-fireworks
committed
revert change
ershang-fireworks
committed
share VSCode settings (#40)
Dylan Huang
authored
format everything (#42)
Dylan Huang
authored
add
mayinghan
committed
add
mayinghan
committed
update
mayinghan
committed
remove reward_kit (#44)
Dylan Huang
authored

Commits on Jul 25, 2025

Commits on Jul 26, 2025

Commits on Jul 27, 2025

Commits on Jul 28, 2025

Commits on Jul 29, 2025

Commits on Jul 31, 2025

fix async test handling (#79)
Dylan Huang
authored
Execute Rollouts now outputs EvaluationRow (#76)
xzrderek
authored

Commits on Aug 1, 2025

Commits on Aug 3, 2025

Merge branch 'main' into pytest_for_pointwise
Dylan Huang
committed
save
Dylan Huang
committed
Refactor async handling in evaluation functions by introducing a dedicated _execute_function to streamline execution of both async and non-async functions.
Dylan Huang
committed
Add note to test_word_count_evaluate function explaining its purpose and limitations
Dylan Huang
committed
Refactor evaluation_test function to enforce parameter type validation for pointwise and batch modes, updating tests to use 'rows' instead of 'input_dataset' for consistency.
Dylan Huang
committed
move decorator into its own file
Dylan Huang
committed
fix __init__.py
Dylan Huang
committed
fix
Dylan Huang
committed
Merge pull request #4 from eval-protocol/pytest_for_pointwise
Dylan Huang
authored
Refactor rollouts to accept list (#7)
Dylan Huang
authored
accept evaluation_test kwargs in decorator and delete "evaluate" (#8)
Dylan Huang
authored

Commits on Aug 4, 2025