Skip to content

[Core] Free KV cache GPU memory on engine shutdown#28953

Open
markmc wants to merge 4 commits intovllm-project:mainfrom
markmc:llm-engine-shutdown
Open

[Core] Free KV cache GPU memory on engine shutdown#28953
markmc wants to merge 4 commits intovllm-project:mainfrom
markmc:llm-engine-shutdown

Commits

Commits on Nov 18, 2025