vllm
95995bbe - [ROCm][Engine] Fix GPU memory leaks in engine shutdown and test workaround for async KV prefix cache reset (#38503)

Commit
209 days ago
[ROCm][Engine] Fix GPU memory leaks in engine shutdown and test workaround for async KV prefix cache reset (#38503) Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Parents
Loading