vllm
299f8291 - DeepGEMM LL optimizations

Commit
1 year ago
DeepGEMM LL optimizations - Quantized dispatch - Fused act-and-mul-and-quant in the right layout for DeepGEMM Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Author
Parents
Loading