vllm
a0fe7ea2 - [feat] Add per-block extra_keys to KV events (#33304)

Commit
77 days ago
[feat] Add per-block extra_keys to KV events (#33304) Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com> Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com> Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Author
Parents
Loading