vllm
0e71eaa6 - [Feature] AWQ marlin quantization support for fused moe with lora (#30442)

Commit

6 days ago

[Feature] AWQ marlin quantization support for fused moe with lora (#30442) Signed-off-by: princepride <wangzhipeng628@gmail.com>

References

Author

princepride

Parents