vllm
[NVIDIA] Add support for cudnn fp4 gemm via flashinfer
#26107

Merged

[NVIDIA] Add support for cudnn fp4 gemm via flashinfer #26107

mgoin merged 5 commits into vllm-project:main from kaixih:add_flashinfer_cudnn_fp4_gemm

kaixih requested a review from

mgoin 183 days ago

kaixih requested a review from

robertgshaw2-redhat 183 days ago

kaixih requested a review from

tlrmchlsmth 183 days ago

kaixih requested a review from

yewentao256 183 days ago

gemini-code-assist commented on 2025-10-02

mergify added needs-rebase

pavanimajety commented on 2025-10-06

kaixih force pushed 179 days ago

mergify removed needs-rebase

kaixih force pushed 179 days ago

mgoin commented on 2025-10-06

pavanimajety commented on 2025-10-06

Add support for cudnn fp4 gemm

4733d7cf

kaixih force pushed to 4733d7cf 179 days ago

mergify added needs-rebase

Merge branch 'main' into add_flashinfer_cudnn_fp4_gemm

e8398c32

mergify removed needs-rebase

Fix

2be2a126

Bad envs merge

d7fdeb13

mgoin added kernel

mgoin added ready

Merge branch 'main' into add_flashinfer_cudnn_fp4_gemm

cd2cf15d

pavanimajety approved these changes on 2025-10-15

mgoin approved these changes on 2025-10-15

mgoin merged de92d916 into main 170 days ago

Reviewers

mgoin

pavanimajety

gemini-code-assist

robertgshaw2-redhat

tlrmchlsmth

yewentao256

Assignees

No one assigned

Labels

ready

Milestone

No milestone

vllm [NVIDIA] Add support for cudnn fp4 gemm via flashinfer #26107 Merged

[NVIDIA] Add support for cudnn fp4 gemm via flashinfer #26107

vllm
[NVIDIA] Add support for cudnn fp4 gemm via flashinfer
#26107

Merged