text-generation-inference
e87893d3 - chore: Update to marlin-kernels 0.3.6 (#2771)

Commit
1 year ago
chore: Update to marlin-kernels 0.3.6 (#2771) This fixes a bug in 2:4 Marlin: https://github.com/vllm-project/vllm/pull/10464
Author
Parents
Loading