vllm
13ea39bc - [CPU]Parallelize over tokens in int4 moe (#29600)

Commit

285 days ago

[CPU]Parallelize over tokens in int4 moe (#29600) Signed-off-by: Zhang Xiangze <Xiangze.Zhang@arm.com>

References

Author

xiangze-arm

Parents