Skip to content

Pull requests: NVIDIA-NeMo/Evaluator

New pull request New
19 Open 1,040 Closed
19 Open 1,040 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix(traffic): persist request hashes in model traffic logs
#1097 opened Jul 3, 2026 by AWarno Contributor Loading…
2
feat: OpenHands condenser
#1095 opened Jul 1, 2026 by e-dobrowolska Loading…
10
fix(judge): don't let an unparseable judge reply silently score 0 community-request waiting-on-maintainers Waiting on maintainers to respond
#1094 opened Jun 29, 2026 by Vidhate Loading…
17
feat: in-container local sandbox + reasoning-model scoring fixes
#1093 opened Jun 25, 2026 by hychiang-git Loading…
25
fix(adapters): add Qwen-safe turn_counter reminder modes
#1090 opened Jun 24, 2026 by fsiino-nvidia Loading…
9
fix: relabel cap-truncated finish_reason to length and flag empty generations
#1087 opened Jun 23, 2026 by teelinsan Contributor Loading…
@teelinsan
18
feat: derive version from git tags via hatch-vcs
#1081 opened Jun 17, 2026 by wprazuch Contributor Loading…
12
docs: drop 0.1.0 (NeMo Eval predecessor) from version switcher
#1064 opened Jun 8, 2026 by lbliii Contributor • Draft
2
Version bump to 0.4.0rc0.dev0
#1050 opened Jun 3, 2026 by github-actions Bot Loading…
1
feat(benchmarks): add ToolSandbox multi-turn tool-use benchmark CI tests
#1018 opened May 18, 2026 by wprazuch Contributor Loading…
2
experimental(slurm): add eval_ray_cluster multi-node bootstrap for agentic Gym evals nemo-evaluator-launcher tests
#1016 opened May 15, 2026 by agronskiy Collaborator Loading…
ci: add GitLab container build config for dev/0.3.0 (public containers)
#1015 opened May 14, 2026 by wprazuch Contributor Loading…
2
feat: harden NVCF endpoint handling documentation Improvements or additions to documentation nemo-evaluator nemo-evaluator-launcher tests
#1008 opened May 12, 2026 by manojkilaru97 Loading…
1
feat: add ATIF retrieved context metric documentation Improvements or additions to documentation tests
#982 opened May 6, 2026 by SandyChapman • Draft
2
Add ExactMatch Metric scorer PoC tests
#961 opened May 4, 2026 by SandyChapman • Draft
3
feat(byob): port multiple-choice loglikelihood + few-shot onto shared metric contract scripts tests
#955 opened May 4, 2026 by wprazuch Contributor • Draft
5 of 7 tasks
2
feat: add shared metric contract for scorer functions tests
#950 opened Apr 29, 2026 by SandyChapman Loading…
8
feat(tasks): Add RASB 26H1 evaluator integration CI community-request documentation Improvements or additions to documentation nemo-evaluator nemo-evaluator-launcher tests waiting-on-maintainers Waiting on maintainers to respond
#943 opened Apr 27, 2026 by pbelcak Loading…
5
feat: add local no-docker mode for nemo-evaluator-launcher community-request documentation Improvements or additions to documentation nemo-evaluator-launcher tests waiting-on-maintainers Waiting on maintainers to respond
#786 opened Mar 1, 2026 by mishana Loading…
@prokotg
26
ProTip! Updated in the last three days: updated:>2026-07-02.