Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TensorRT 8.5.2 PASS but TensorRT 10.4.0 FAILED #4334

Closed
yijun02 opened this issue Jan 22, 2025 · 4 comments
Closed

TensorRT 8.5.2 PASS but TensorRT 10.4.0 FAILED #4334

yijun02 opened this issue Jan 22, 2025 · 4 comments
Labels
question Further information is requested triaged Issue has been triaged by maintainers

Comments

@yijun02
Copy link

yijun02 commented Jan 22, 2025

I am trying to convert an open-clip model to TensorRT:

I converted the model and found that there was a problem with the accuracy so I used the following command:

polygraphy run model.onnx --trt --onnxrt > comparison_results.txt

the command's result:
comparison_results_r35.txt
comparison_results_r36.txt

docker image:
dustynv/l4t-pytorch:2.2-r35.4.1
dustynv/l4t-pytorch:r36.4.0

code and onnx:
https://drive.google.com/file/d/1YXDKsnEYa_v6Un44lG12QVTVw-dzNr5E/view?usp=sharing

@lix19937
Copy link

Try to use trt10.6 or trt10.7.

@yijun02
Copy link
Author

yijun02 commented Jan 23, 2025

I tried using trt10.7 but had the same problem.

I used the following command:
polygraphy run model.onnx --trt --onnxrt > comparison_results.txt

the command's result:
comparison_results.txt

docker image:
nvcr.io/nvidia/pytorch:24.12-py3

Is it the same problem as #4333 ?

@yijun02
Copy link
Author

yijun02 commented Feb 3, 2025

I'm using TensorRT 10.8 in the nvcr.io/nvidia/pytorch:25.01-py3 container works as expected. But how do I use TensorRT 10.8 on Jetson without using the PyTorch container?

@kevinch-nv kevinch-nv added question Further information is requested triaged Issue has been triaged by maintainers labels Feb 7, 2025
@kevinch-nv
Copy link
Collaborator

Due to some issues a Jetson TensorRT 10.8 is not available on Jetson. Jetson packages will be available again in the 10.9 release. Given that the original accuracy issue has been resolved in 10.8, closing this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested triaged Issue has been triaged by maintainers
Projects
None yet
Development

No branches or pull requests

3 participants