vllm
b2e1fc35 - [Bugfix][Core] Fix CPU memory leak from Request reference cycle in prefix caching (#34183)

Commit
70 days ago
[Bugfix][Core] Fix CPU memory leak from Request reference cycle in prefix caching (#34183) Signed-off-by: Roger Wang <hey@rogerw.io> (cherry picked from commit 8a5e0e2b2bb925d162328927b7565514fa355da1)
Author
Committer
Parents
Loading