[Usage]:I noticed that CPU memory continues to increase during the TensorRT-LLM operation. Is this normal? Could there be a memory leak?

[july8023]

System Info

System Information:

• OS:
• Python version:
• CUDA version:
• GPU model(s):
• Driver version:
• TensorRT-LLM version:

Detailed output:

Paste the output of the above commands here

I noticed that CPU memory continues to increase during the TensorRT-LLM operation. Is this normal? Could there be a memory leak?

How would you like to use TensorRT-LLM

I want to run inference of a [specific model](put Hugging Face link here). I don't know how to integrate it with TensorRT-LLM or optimize it for my use case.

Specific questions:

• Model:
• Use case (e.g., chatbot, batch inference, real-time serving):
• Expected throughput/latency requirements:
• Multi-GPU setup needed:

Before submitting a new issue...

• Make sure you already searched for relevant issues, and checked the documentation and examples for answers to frequently asked questions.