vllm
bdf13965 - [V1] Support cross-layer KV sharing (#18212)

Commit

190 days ago

[V1] Support cross-layer KV sharing (#18212) Signed-off-by: Yong Hoon Shin <yhshin@meta.com>

References

Author

sarckk

Parents