vllm
379689d5 - [Perf] Support FP8 KV cache for Flashinfer MLA Sparse (#35891)

Commit

51 days ago

[Perf] Support FP8 KV cache for Flashinfer MLA Sparse (#35891)

References

#35891 - [Perf] Support FP8 KV cache for Flashinfer MLA Sparse

Author

wzhao18

wzhao18

Parents

Loading