vllm
b36adfa3 - [Perf] Set Flashinfer sparse MLA as default backend for FP8 kv cache (#37252)

Commit

181 days ago

[Perf] Set Flashinfer sparse MLA as default backend for FP8 kv cache (#37252) Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>

References

Author

wzhao18

Parents