vllm
da5e7b12 - [MLA] Fuse cat and qaunt for fp8 kv-cache (#32950)

Commit

20 days ago

[MLA] Fuse cat and qaunt for fp8 kv-cache (#32950) Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

References

Author

LucasWilkinson

Parents