vllm
95995bbe
- [ROCm][Engine] Fix GPU memory leaks in engine shutdown and test workaround for async KV prefix cache reset (#38503)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
209 days ago
[ROCm][Engine] Fix GPU memory leaks in engine shutdown and test workaround for async KV prefix cache reset (#38503) Signed-off-by: Andreas Karatzas <akaratza@amd.com>
References
#38503 - [ROCm][Engine] Fix GPU memory leaks in engine shutdown and test workaround for async KV prefix cache reset
Author
AndreasKaratzas
Parents
07351e08
Loading