vllm
32431583 - [V1] Move KV block hashes from Request to KVCacheManager (#12922)

Commit

310 days ago

[V1] Move KV block hashes from Request to KVCacheManager (#12922) Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

References

Author

WoosukKwon

Parents