Skip to content

enable eval forge llm #2018

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
knovokmetTT wants to merge 43 commits into
base: dev
Choose a base branch
from
Draft

enable eval forge llm #2018

knovokmetTT wants to merge 43 commits into from

Conversation

@knovokmetTT
Copy link
Contributor

@knovokmetTT knovokmetTT commented Feb 5, 2026

No description provided.

ljovanovicTT and others added 30 commits January 16, 2026 10:43
@ljovanovicTT
Add Forge LLM Model Specs
6ffd4a3
@ljovanovicTT
Refactor Setting Environment Variables
fb25c16
@ljovanovicTT
Ruff Format
d82e9e8
@ljovanovicTT
Fix Falling Reports
9ca26d2
@ljovanovicTT
Update Model Configs Constants with Forge Runner
f48cdcd
@knovokmetTT
Merge branch 'dev' into ljovanovic/feature_add_forge_llm_model_specs
c1d35d8
@knovokmetTT
fix model name
357cbf8
@knovokmetTT
Merge branch 'ljovanovic/feature_add_forge_llm_model_specs' into knov…
d25a7b5 
…okmetTT/qfix-model-env-var-override
@knovokmetTT
tests for maintance api
26a40fd
@knovokmetTT
Merge pull request #1796 from tenstorrent/knovokmetTT/qfix-model-env-…
5301b48 
…var-override

qfix model env var override
@knovokmetTT
Merge branch 'dev' into ljovanovic/feature_add_forge_llm_model_specs
46cf122
@knovokmetTT
fix dockerfile
4a042bb
@ljovanovicTT
Fix ModelConfigs
f8dfdd7
@knovokmetTT
docs + api key fix
31eef57
@ljovanovicTT
Set vLLM Api Key For Media Server
e907921
@ljovanovicTT
Fix Streaming
648b63a
@ljovanovicTT
Ruff Format
15c838b
@knovokmetTT
Merge branch 'dev' into ljovanovic/feature_add_forge_llm_model_specs
2f5bce7
@knovokmetTT
set default impl false for llama 323b forge
8645548
@knovokmetTT
export OPENAI api key
2e90a0e
@knovokmetTT
cleanup
82c835d
@ljovanovicTT
Merge branch 'dev' into ljovanovic/feature_add_forge_llm_model_specs
54dac7c
@knovokmetTT
Merge branch 'dev' into ljovanovic/feature_add_forge_llm_model_specs
a2c0a1c
@ljovanovicTT
Update max_batch_size
9062710
@knovokmetTT
update forge readme + delete traces of VLLMForge naming
3eb4ce5
@knovokmetTT
fix vllm.model to only be assigned if modelSvc is LLM
6793b68
@ljovanovicTT
Merge branch 'dev' into ljovanovic/feature_add_forge_llm_model_specs
63f968e
@knovokmetTT
Merge branch 'dev' into ljovanovic/feature_add_forge_llm_model_specs
0138244
@knovokmetTT
Merge remote-tracking branch 'origin/dev' into ljovanovic/feature_add…
8698cc1 
…_forge_llm_model_specs
@ljovanovicTT
Merge branch 'dev' into ljovanovic/feature_add_forge_llm_model_specs
590cf7e
@github-actions
Copy link
Contributor

github-actions bot commented Feb 5, 2026 •
edited
Loading

✅ Test Coverage Report

Coverage of Changed Lines

Metric Value
Coverage 81%
Threshold 50%
Status ✅ PASSED

💡 This checks coverage of newly added/modified lines only, not total codebase coverage.

@github-actions
Copy link
Contributor

github-actions bot commented Feb 5, 2026 •
edited
Loading

✅ Test Results - PASSED

Summary

Component Total Passed Skipped Failed Status
tt-inference-server 383 383 0 0 ✅
tt-media-server 476 476 0 0 ✅
Overall 859 859 0 0 ✅

Details

  • Python Version: 3.10
  • Workflow: Test Gate
  • Commit: 09dc25a
  • Run ID: 21716830684

🎉 All tests passed! This PR is ready for review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@tstescoTT tstescoTT Awaiting requested review from tstescoTT tstescoTT will be requested when the pull request is marked ready for review tstescoTT is a code owner

@bgoelTT bgoelTT Awaiting requested review from bgoelTT bgoelTT will be requested when the pull request is marked ready for review bgoelTT is a code owner

@idjuricTT idjuricTT Awaiting requested review from idjuricTT idjuricTT will be requested when the pull request is marked ready for review idjuricTT is a code owner

@stisiTT stisiTT Awaiting requested review from stisiTT stisiTT will be requested when the pull request is marked ready for review stisiTT is a code owner

@gtobarTT gtobarTT Awaiting requested review from gtobarTT gtobarTT will be requested when the pull request is marked ready for review gtobarTT is a code owner

@arobergeTT arobergeTT Awaiting requested review from arobergeTT arobergeTT will be requested when the pull request is marked ready for review arobergeTT is a code owner

@ssanjayTT ssanjayTT Awaiting requested review from ssanjayTT ssanjayTT will be requested when the pull request is marked ready for review ssanjayTT is a code owner

@ztorlakTT ztorlakTT Awaiting requested review from ztorlakTT ztorlakTT will be requested when the pull request is marked ready for review ztorlakTT is a code owner

@fivanovicTT fivanovicTT Awaiting requested review from fivanovicTT fivanovicTT will be requested when the pull request is marked ready for review fivanovicTT is a code owner

@ljovanovicTT ljovanovicTT Awaiting requested review from ljovanovicTT ljovanovicTT will be requested when the pull request is marked ready for review ljovanovicTT is a code owner

@dmadicTT dmadicTT Awaiting requested review from dmadicTT dmadicTT will be requested when the pull request is marked ready for review dmadicTT is a code owner

@vpetrovicTT vpetrovicTT Awaiting requested review from vpetrovicTT vpetrovicTT will be requested when the pull request is marked ready for review vpetrovicTT is a code owner

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@knovokmetTT @ljovanovicTT