The CUDA graph capture on the stream has failed

[zsh4614]

Description

Environment

TensorRT Version: 8.5.2

NVIDIA GPU: 3090

NVIDIA Driver Version:

CUDA Version: 11.4

CUDNN Version:

Operating System:

Python Version (if applicable):

Tensorflow Version (if applicable):

PyTorch Version (if applicable):

Baremetal or Container (if so, version):

Relevant Files

Model link:

log.txt

Steps To Reproduce

Commands or scripts:

Have you tried the latest release?:

Can this model run on other frameworks? For example run ONNX model with ONNXRuntime (polygraphy run <model.onnx> --onnxrt):

[lix19937]

Maybe your libcustom_trt_plugin.so write does not meet the requirements of the graph capture. And advoid warning, you need update cuDNN from 8.4.1 to 8.6.0.

[kevinch-nv]

As @lix19937 mentioned, your plugin may be incompatible with cuda graph capture requirements. Are you able to share more information on your plugin and model?