vllm
[Bugfix] FlashInfer MXINT4 MoE crashes, missing do_finalize
#39315

Merged

[Bugfix] FlashInfer MXINT4 MoE crashes, missing do_finalize #39315

benchislett merged 4 commits into vllm-project:main from CentML:bugfix-mxint4-moe

fix flashinfer mxint4 crash

3067ce5f

benchislett requested a review from

mgoin 5 days ago

benchislett requested a review from

robertgshaw2-redhat 5 days ago

benchislett requested a review from

tlrmchlsmth 5 days ago

benchislett requested a review from

yewentao256 5 days ago

benchislett requested a review from

pavanimajety 5 days ago

mergify added nvidia

mergify added bug

gemini-code-assist commented on 2026-04-08

add unit test for mxint4 wrapper

ea0a7c4c

benchislett requested a review from

WoosukKwon 5 days ago

change test to cover wrapper only

e2c85417

Update vllm/model_executor/layers/quantization/utils/flashinfer_mxint…

2f66debf

mgoin approved these changes on 2026-04-08

mgoin added ready

benchislett merged 8332078c into main 4 days ago

benchislett deleted the bugfix-mxint4-moe branch 4 days ago

Reviewers

mgoin

gemini-code-assist

robertgshaw2-redhat

tlrmchlsmth

yewentao256

pavanimajety

WoosukKwon

Assignees

No one assigned

Labels

bug ready nvidia

Milestone

No milestone