Skip to content

Issues: mlcommons/inference

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

177 Open 692 Closed
177 Open 692 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

SingleStream Scenario crashes
#2101 opened Feb 7, 2025 by kingjuno
2
SingleStream scenario crashes for Resnet50
#2100 opened Feb 7, 2025 by nintendoit
2
Inference [4.1.5] Inference nvidia-smi command exits but failed to execute
#2098 opened Feb 6, 2025 by msalaz03
Launch issue with Medical Imaging using 3d-unet
#2095 opened Feb 6, 2025 by Agalakdak
1
Create MLCommons Croissant Metadata for the Datasets created by MLCommons Inference WG croissant
#2076 opened Feb 2, 2025 by arjunsuresh
Official Readme files are having Huggingface Download Links for the Llama models needed-for-v5.0
#2075 opened Feb 1, 2025 by arjunsuresh
Release mlcommons inference submission tools as a Python package postmortem 5.0
#2074 opened Feb 1, 2025 by arjunsuresh
Need to fix TEST01 performance check postmortem 5.0
#2072 opened Feb 1, 2025 by arjunsuresh
[405b-SUT] Max number of output tokens
#2060 opened Jan 28, 2025 by attafosu
1
The documents are outdated
#2048 opened Jan 23, 2025 by MohdShariq91
1
Save the docker with Resnet50 running successfully and load it on another system with the same config but fail to run Resnet50
#2023 opened Jan 9, 2025 by Bob123Yang
1
Fail to build the GPT-J docker after successfully installation of tensorrt-llm
#2022 opened Jan 8, 2025 by Bob123Yang
2
mixtral-8x7b: Reference Implementation Accuracy Failure on H200
#2018 opened Jan 7, 2025 by mrmhodak
8
Metrics definition and settings used for LLM benchmarks
#2012 opened Jan 3, 2025 by vineel96
1
GPT-J Huggingface validation error
#2010 opened Jan 2, 2025 by Xi0131
3
why did the specified data precision not work for MLPerf inference?
#2006 opened Dec 31, 2024 by Bob123Yang
4
CM script failed to run harness after docker done
#1998 opened Dec 24, 2024 by Bob123Yang
2
CM script not recognizing custom nvmitten wheel on ARM CPU + Nvidia GPU setup
#1991 opened Dec 18, 2024 by ChrisHuang96
20
Update system_requirements.yml file for all the reference models documentation
#1986 opened Dec 16, 2024 by arjunsuresh
llama3: performance_sample_count update
#1979 opened Dec 13, 2024 by viraatc
1
Error: Cannot perform a '--user' install. User site-packages are not visible in the virtual environment. CM error : portable CM script failed (name = build-mlperf-inference-server-nvidia, return code = 256)
#1972 opened Dec 11, 2024 by shyambansal17
9
[Llama3] Error when multiple GPUs are used
#1957 opened Dec 3, 2024 by pgmpablo157321
[Llama3] Docker dependencies issues
#1956 opened Dec 3, 2024 by pgmpablo157321
GNN/R-GAT Inference Submission disallows sorting of the nodes. Need a mechanism to prevent and detect sorting.
#1950 opened Nov 22, 2024 by ukurkure
6
[v4.1 inference] Detected system did not match any known systems.
#1937 opened Nov 18, 2024 by loganwuw
1
ProTip! no:milestone will show everything without a milestone.