vllm
868c546d - Support W8A8 INT8 MoE for compressed-tensors (#16745)

Commit

224 days ago

Support W8A8 INT8 MoE for compressed-tensors (#16745) Signed-off-by: mgoin <mgoin64@gmail.com>

References

Author

mgoin

Parents