vllm
e97f802b - [FP8][Kernel] Dynamic kv cache scaling factors computation (#11906)

Commit
309 days ago
[FP8][Kernel] Dynamic kv cache scaling factors computation (#11906) Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com> Co-authored-by: Micah Williamson <micah.williamson@amd.com>
Author
Parents
Loading