Skip to content

GPT-OSS evals and RAM fix #1941

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
stisiTT wants to merge 9 commits into
base: dev
Choose a base branch
from
Draft

GPT-OSS evals and RAM fix #1941

stisiTT wants to merge 9 commits into from

Conversation

@stisiTT
Copy link
Contributor

@stisiTT stisiTT commented Jan 29, 2026

No description provided.

@stisiTT stisiTT self-assigned this Jan 29, 2026
@stisiTT stisiTT added bug Something isn't working Models CI onboarding Issue for model onboarding on Models CI, has to be triaged by respective model owner teams labels Jan 29, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Jan 29, 2026 •
edited
Loading

✅ Test Coverage Report

Coverage of Changed Lines

Metric Value
Coverage %
Threshold 50%
Status ✅ PASSED

💡 This checks coverage of newly added/modified lines only, not total codebase coverage.

@github-actions
Copy link
Contributor

github-actions bot commented Jan 29, 2026 •
edited
Loading

✅ Test Results - PASSED

Summary

Component Total Passed Skipped Failed Status
tt-inference-server 352 352 0 0 ✅
tt-media-server 433 407 26 0 ✅
Overall 785 759 26 0 ✅

Details

  • Python Version: 3.10
  • Workflow: Test Gate
  • Commit: 1683756
  • Run ID: 21530832025

🎉 All tests passed! This PR is ready for review.

@stisiTT
TEMP: Commented out unused evaluation tasks (GPQA, MMLU Pro, R1 AIME2…
7f579af 
…4) in `eval_config.py`. Retained AIME25 task for active configurations.
@stisiTT
Add gen_kwargs with reasoning_effort configuration to evaluation …
3af1255 
…tasks in `eval_config.py`.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@tstescoTT tstescoTT Awaiting requested review from tstescoTT tstescoTT will be requested when the pull request is marked ready for review tstescoTT is a code owner

@bgoelTT bgoelTT Awaiting requested review from bgoelTT bgoelTT will be requested when the pull request is marked ready for review bgoelTT is a code owner

@gtobarTT gtobarTT Awaiting requested review from gtobarTT gtobarTT will be requested when the pull request is marked ready for review gtobarTT is a code owner

@arobergeTT arobergeTT Awaiting requested review from arobergeTT arobergeTT will be requested when the pull request is marked ready for review arobergeTT is a code owner

@ssanjayTT ssanjayTT Awaiting requested review from ssanjayTT ssanjayTT will be requested when the pull request is marked ready for review ssanjayTT is a code owner

@idjuricTT idjuricTT Awaiting requested review from idjuricTT idjuricTT will be requested when the pull request is marked ready for review idjuricTT is a code owner

At least 1 approving review is required to merge this pull request.

Assignees

@stisiTT stisiTT

Labels

bug Something isn't working Models CI onboarding Issue for model onboarding on Models CI, has to be triaged by respective model owner teams

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@stisiTT