New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Request latest version of TensorRT-LLM #791

Open

xiaoyuzju opened this issue Jan 22, 2025 · 4 comments

xiaoyuzju commented Jan 22, 2025

hi, could you please add a docker image for the latest version (0.16.0) of TensorRT-LLM? Thank you.

Collaborator

johnnynunez commented Jan 22, 2025 •

edited

Loading

Only exists 0.12 jetson build: https://github.com/NVIDIA/TensorRT-LLM/tree/v0.12.0-jetson

Collaborator

johnnynunez commented Jan 23, 2025

@dusty-nv maybe I can update the branch and ported to 0.16.0... and try if it works

Author

xiaoyuzju commented Jan 23, 2025

@dusty-nv maybe I can update the branch and ported to 0.16.0... and try if it works

That would be great for people who need to use the new models!

Collaborator

johnnynunez commented Jan 23, 2025

Keep in touch

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment