vllm
[V1] Use FlashInfer by default on Blackwell GPUs
#19118

Merged

[V1] Use FlashInfer by default on Blackwell GPUs #19118

mgoin merged 5 commits into vllm-project:main from neuralmagic:blackwell-default-flashinfer

Use FlashInfer by default on Blackwell GPUs

3a00186f

gemini-code-assist commented on 2025-06-04

gemini-code-assist requested changes on 2025-06-04

Review

f1f6aff7

houseroad commented on 2025-06-04

Only do for V1 and add is_device_capability

387380df

Merge branch 'blackwell-default-flashinfer' of https://github.com/neu…

99f3f6ff

Update message

3bfc9bb0

mgoin changed the title ~~Use FlashInfer by default on Blackwell GPUs~~ [V1] Use FlashInfer by default on Blackwell GPUs 193 days ago

mgoin added performance

mgoin added v1

mgoin added ready

mgoin requested a review from

simon-mo 193 days ago

simon-mo approved these changes on 2025-06-04

youkaichao commented on 2025-06-05

mgoin added this to the v0.9.1 milestone 193 days ago

mgoin merged 87360308 into main 192 days ago

Reviewers

simon-mo

gemini-code-assist

youkaichao

houseroad

Assignees

No one assigned

Labels

performance ready v1

Milestone

v0.9.1