vllm
[Bugfix] Fix topk_ids indices_type for CUTLASS w8a8 FP8 MoE
#20166

Merged

[Bugfix] Fix topk_ids indices_type for CUTLASS w8a8 FP8 MoE #20166

tlrmchlsmth merged 6 commits into vllm-project:main from minosfuture:fix_topk_id_dtype

minosfuture requested a review from

mgoin 319 days ago

minosfuture requested a review from

robertgshaw2-redhat 319 days ago

minosfuture requested a review from

tlrmchlsmth 319 days ago

gemini-code-assist commented on 2025-06-27

tlrmchlsmth commented on 2025-07-03

mergify added needs-rebase

tlrmchlsmth closed this 313 days ago

tlrmchlsmth reopened this 313 days ago

tlrmchlsmth commented on 2025-07-03

[Bugfix] Fix topk_ids indices_type for cutlass w8a8 fp8 moe

6d0e19a6

Address comment: change moe_data topk_ids type back to int32_t

7c57bb06

Address comment: add expert_map==None assertion in pplx_prepare_finalize

376bcde5

Fix after rebase: cutlass_moe_fp8 signature is changed

6ca83a48

minosfuture force pushed from e5ed8221 to 6ca83a48 313 days ago

mergify removed needs-rebase

Address comment: change pplx id type to int32

ec668c31

minosfuture commented on 2025-07-03

minosfuture commented on 2025-07-05

tlrmchlsmth commented on 2025-07-07

Address comment: revert type change for deepep_ll for now

beeba9a1

minosfuture force pushed to beeba9a1 309 days ago

tlrmchlsmth approved these changes on 2025-07-08

tlrmchlsmth added ready

tlrmchlsmth enabled auto-merge (squash) 308 days ago

tlrmchlsmth merged c438183e into main 308 days ago

robertgshaw2-redhat commented on 2025-07-12

Reviewers

tlrmchlsmth

robertgshaw2-redhat

varun-sundar-rabindranath

gemini-code-assist

mgoin

Assignees

No one assigned

Labels

ready

Milestone

No milestone

vllm [Bugfix] Fix topk_ids indices_type for CUTLASS w8a8 FP8 MoE #20166 Merged

[Bugfix] Fix topk_ids indices_type for CUTLASS w8a8 FP8 MoE #20166

vllm
[Bugfix] Fix topk_ids indices_type for CUTLASS w8a8 FP8 MoE
#20166

Merged