vllm
[Bugfix] Allocate less memory in non-batched CUTLASS MoE
#21121

Merged

[Bugfix] Allocate less memory in non-batched CUTLASS MoE #21121

DarkLight1337 merged 2 commits into vllm-project:main from neuralmagic:cutlass-moe-less-mem

Allocate less memory in CUTLASS MoE

ba131c36

gemini-code-assist commented on 2025-07-17

mgoin commented on 2025-07-17

mgoin added bug

mgoin approved these changes on 2025-07-17

mgoin added ready

Merge branch 'main' into cutlass-moe-less-mem

1712fc49

DarkLight1337 merged 4adc66f6 into main 247 days ago

Reviewers

mgoin

gemini-code-assist

Assignees

No one assigned

Labels

bug ready

Milestone

No milestone