vllm
[ModelOpt] Remove NVFP4 MoE K%16==0 constraint
#26891

Merged

[ModelOpt] Remove NVFP4 MoE K%16==0 constraint #26891

mgoin merged 1 commit into vllm-project:main from XiaobingSuper:xiaobing/tp_moe_fp4

make TP>1 works for nv-fp4 moe

d5f02a6c

XiaobingSuper requested a review from

mgoin 211 days ago

XiaobingSuper requested a review from

robertgshaw2-redhat 211 days ago

XiaobingSuper requested a review from

tlrmchlsmth 211 days ago

XiaobingSuper requested a review from

yewentao256 211 days ago

gemini-code-assist commented on 2025-10-15

mgoin approved these changes on 2025-10-15

mgoin added ready

mgoin changed the title ~~make TP>1 works for nv-fp4 moe~~ [ModelOpt] Remove NVFP4 MoE K%16==0 constraint 211 days ago

pavanimajety commented on 2025-10-15

pavanimajety approved these changes on 2025-10-15

mgoin merged d7963752 into main 211 days ago

Reviewers

pavanimajety

mgoin

gemini-code-assist

robertgshaw2-redhat

tlrmchlsmth

yewentao256

Assignees

No one assigned

Labels

ready

Milestone

No milestone