Skip to content

Pull requests: NVIDIA-NeMo/Evaluator

New pull request New
18 Open 1,009 Closed
18 Open 1,009 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

docs: drop 0.1.0 (NeMo Eval predecessor) from version switcher
#1064 opened Jun 8, 2026 by lbliii • Draft
2
docs: migrate documentation from Sphinx to Fern
#1062 opened Jun 4, 2026 by lbliii Loading…
@lbliii
2
Version bump to 0.4.0rc0.dev0
#1050 opened Jun 3, 2026 by github-actions Bot Loading…
1
feat: Add new error type SOLVE_TIMEOUT
#1049 opened Jun 3, 2026 by mpatel31415 Loading…
3
feat(benchmarks): add ToolSandbox multi-turn tool-use benchmark CI tests
#1018 opened May 18, 2026 by wprazuch Contributor Loading…
2
experimental(slurm): add eval_ray_cluster multi-node bootstrap for agentic Gym evals nemo-evaluator-launcher tests
#1016 opened May 15, 2026 by agronskiy Collaborator Loading…
ci: add GitLab container build config for dev/0.3.0 (public containers)
#1015 opened May 14, 2026 by wprazuch Contributor Loading…
2
feat: harden NVCF endpoint handling documentation Improvements or additions to documentation nemo-evaluator nemo-evaluator-launcher tests
#1008 opened May 12, 2026 by manojkilaru97 Loading…
1
ci: Ensure bump branch is created first for dependabot CI
#1005 opened May 11, 2026 by chtruong814 Loading…
feat: add ATIF retrieved context metric documentation Improvements or additions to documentation tests
#982 opened May 6, 2026 by SandyChapman • Draft
2
feat(launcher): per-task deployment_overrides nemo-evaluator-launcher tests
#973 opened May 5, 2026 by AdamRajfer Loading…
1
Add ExactMatch Metric scorer PoC tests
#961 opened May 4, 2026 by SandyChapman • Draft
3
feat(byob): port multiple-choice loglikelihood + few-shot onto shared metric contract scripts tests
#955 opened May 4, 2026 by wprazuch Contributor • Draft
5 of 7 tasks
2
feat: add shared metric contract for scorer functions tests
#950 opened Apr 29, 2026 by SandyChapman Loading…
8
feat(tasks): Add RASB 26H1 evaluator integration CI community-request documentation Improvements or additions to documentation nemo-evaluator nemo-evaluator-launcher tests waiting-on-maintainers Waiting on maintainers to respond
#943 opened Apr 27, 2026 by pbelcak Loading…
5
fix(slurm): request zero GPUs when export falls back to GPU partition nemo-evaluator-launcher
#915 opened Apr 17, 2026 by AdamRajfer Loading…
feat: add generic heartbeat for periodic script execution during evaluation documentation Improvements or additions to documentation nemo-evaluator-launcher tests
#876 opened Mar 20, 2026 by AdamRajfer Loading…
4 tasks done
@AdamRajfer
8
feat: add local no-docker mode for nemo-evaluator-launcher community-request documentation Improvements or additions to documentation nemo-evaluator-launcher tests waiting-on-customer Waiting on the original author to respond
#786 opened Mar 1, 2026 by mishana Loading…
@prokotg
26
ProTip! Follow long discussions with comments:>50.