vllm
e0cc5f25 - [V1][BugFix] Free encoder cache for aborted requests (#12545)

Commit

1 year ago

[V1][BugFix] Free encoder cache for aborted requests (#12545) Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

References

Author

WoosukKwon

Parents