vllm
4fb56914 - [perf] Add fused MLA QKV + strided layernorm (#21116)

Commit

170 days ago

[perf] Add fused MLA QKV + strided layernorm (#21116) Signed-off-by: Mickael Seznec <mickael@mistral.ai> Co-authored-by: mgoin <mgoin64@gmail.com>

References

Author

mickaelseznec

Parents