vllm
Flashinfer cuDNN backend for Qwen3 VL ViT attention
#34580
Merged
Overview
Commits
10
Changes
View On GitHub

Flashinfer cuDNN backend for Qwen3 VL ViT attention #34580

Isotr0py merged 10 commits into vllm-project:main from CentML:max/add-vit-fi-cudnn-backend
maxyanghu
maxyanghu maxyanghu requested a review from sighingnow sighingnow 167 days ago
maxyanghu maxyanghu requested a review from LucasWilkinson LucasWilkinson 167 days ago
mergify mergify added qwen
mergify mergify added nvidia
mergify mergify added v1
gemini-code-assist
gemini-code-assist commented on 2026-02-15
maxyanghu maxyanghu force pushed 167 days ago
ywang96 ywang96 assigned ywang96 ywang96 167 days ago
mergify
mergify mergify added needs-rebase
maxyanghu maxyanghu force pushed 166 days ago
mergify mergify removed needs-rebase
wangshangsam
wangshangsam approved these changes on 2026-02-17
wangshangsam
wangshangsam commented on 2026-02-17
DarkLight1337 DarkLight1337 requested a review from Isotr0py Isotr0py 165 days ago
Isotr0py
Isotr0py commented on 2026-02-18
ywang96
ywang96 commented on 2026-02-18
maxyanghu maxyanghu requested a review from mgoin mgoin 164 days ago
maxyanghu maxyanghu requested a review from tlrmchlsmth tlrmchlsmth 164 days ago
maxyanghu maxyanghu requested a review from WoosukKwon WoosukKwon 164 days ago
maxyanghu maxyanghu requested a review from yewentao256 yewentao256 164 days ago
maxyanghu maxyanghu requested a review from Isotr0py Isotr0py 164 days ago
maxyanghu maxyanghu requested a review from ywang96 ywang96 164 days ago
ywang96 ywang96 added ready
maxyanghu maxyanghu force pushed 161 days ago
Isotr0py
mergify mergify added ci/build
maxyanghu maxyanghu force pushed 161 days ago
mergify
Isotr0py
Isotr0py commented on 2026-02-23
add implementation
c437ccab
remove sequence_lengths
5500a6c8
maxyanghu Update vllm/model_executor/models/qwen3_vl.py
23c657d1
maxyanghu refactor and test
a2e22440
maxyanghu refactor
2e664a69
maxyanghu fix test
bc610071
maxyanghu fix format
456bdbef
maxyanghu upgrade cudnn
4dee37fd
maxyanghu fix cudnn test issue
9e6a0fa7
maxyanghu maxyanghu force pushed to 9e6a0fa7 155 days ago
maxyanghu maxyanghu requested a review from MatthewBonanni MatthewBonanni 155 days ago
maxyanghu fix comments
b4d09e94
Isotr0py
Isotr0py approved these changes on 2026-02-27
ywang96
ywang96 approved these changes on 2026-02-27
Isotr0py Isotr0py merged 9c3fe993 into main 155 days ago
wangshangsam wangshangsam assigned maxyanghu maxyanghu 150 days ago
wangshangsam wangshangsam added performance
wangshangsam wangshangsam added multi-modality

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
Labels
performance ready ci/build v1 multi-modality qwen nvidia
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum