vllm
[Bugfix][MoE] FlashInfer one-sided: workspace union across heterogeneous layers
#42976
Merged

[Bugfix][MoE] FlashInfer one-sided: workspace union across heterogeneous layers #42976

tomeras91
tomeras91 Grow FlashInfer one-sided workspace to max of heterogeneous MoE layers
025ede21
mergify mergify added bug
gemini-code-assist
gemini-code-assist commented on 2026-05-18
amitz-nv
amitz-nv commented on 2026-05-18
amitz-nv
amitz-nv commented on 2026-05-18
tomeras91 Assert uniform top_k and num_experts across one-sided MoE layers
da724d14
tomeras91 remove self.hidden_size as it is not used
f115547a
amitz-nv
amitz-nv approved these changes on 2026-05-19
mgoin mgoin added ready
tomeras91 tomeras91 requested a review from mgoin mgoin 77 days ago
mgoin
mgoin approved these changes on 2026-05-19
mgoin mgoin merged f54721bc into main 77 days ago
tomeras91 tomeras91 deleted the fix-flashinfer-one-sided-heterogenuous-moe branch 77 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone