vllm
[Feature]: support serving nvfp4 W4A16 moe models uisng Marlin
#30906

Open

[Feature]: support serving nvfp4 W4A16 moe models uisng Marlin #30906

EdalatiAli wants to merge 6 commits into vllm-project:main from EdalatiAli:main

Add CompressedTensorsW4A16NVfp4MoeMethod to serve nvfp4 W4A16 quantiz…

ade34857

fix naming

419c1b32

add EPLB check

8f54548d

EdalatiAli requested a review from

mgoin 2 days ago

EdalatiAli requested a review from

robertgshaw2-redhat 2 days ago

EdalatiAli requested a review from

tlrmchlsmth 2 days ago

EdalatiAli requested a review from

yewentao256 2 days ago

EdalatiAli requested a review from

pavanimajety 2 days ago

Merge branch 'main' into main

a148e770

gemini-code-assist commented on 2025-12-17

chatgpt-codex-connector commented on 2025-12-17

fix method signitures

88494b62

align maybe_make_prepare_finalize inputs with the parent

051c97ef

Reviewers

gemini-code-assist

mgoin

robertgshaw2-redhat

tlrmchlsmth

yewentao256

pavanimajety

Assignees

No one assigned

Labels

None yet

Milestone

No milestone