vllm
[Attention] FA4 integration
#32974
Merged
Overview
Commits
48
Changes
View On GitHub

[Attention] FA4 integration #32974

LucasWilkinson merged 48 commits into vllm-project:main from neuralmagic:lwilkinson/fa4-integration
LucasWilkinson
LucasWilkinson LucasWilkinson requested a review from WoosukKwon WoosukKwon 42 days ago
LucasWilkinson LucasWilkinson requested a review from youkaichao youkaichao 42 days ago
LucasWilkinson LucasWilkinson requested a review from robertgshaw2-redhat robertgshaw2-redhat 42 days ago
LucasWilkinson LucasWilkinson requested a review from mgoin mgoin 42 days ago
LucasWilkinson LucasWilkinson requested a review from tlrmchlsmth tlrmchlsmth 42 days ago
LucasWilkinson LucasWilkinson requested a review from houseroad houseroad 42 days ago
LucasWilkinson LucasWilkinson requested a review from hmellor hmellor 42 days ago
LucasWilkinson LucasWilkinson requested a review from yewentao256 yewentao256 42 days ago
LucasWilkinson LucasWilkinson requested a review from ProExpertProg ProExpertProg 42 days ago
mergify mergify added ci/build
mergify mergify added nvidia
mergify mergify added v1
gemini-code-assist
gemini-code-assist commented on 2026-01-23
cursor
cursor commented on 2026-01-23
LucasWilkinson LucasWilkinson force pushed 41 days ago
ProExpertProg
ProExpertProg commented on 2026-01-27
ProExpertProg
ProExpertProg commented on 2026-01-27
mergify
LucasWilkinson LucasWilkinson force pushed 37 days ago
mergify
LucasWilkinson LucasWilkinson force pushed 36 days ago
mergify
mergify
mergify mergify added documentation
mergify
LucasWilkinson LucasWilkinson changed the title [Attention][WIP] FA4 integration [Attention] FA4 integration 36 days ago
mergify
mergify mergify added needs-rebase
mergify mergify removed needs-rebase
LucasWilkinson LucasWilkinson force pushed 32 days ago
mergify
mergify mergify added needs-rebase
LucasWilkinson wip
3ed1f29c
LucasWilkinson update
02660c27
LucasWilkinson update
cb870279
LucasWilkinson remove
6ea03958
LucasWilkinson cleanup
8b6039f1
LucasWilkinson fix
d0d0ff60
MatthewBonanni Update docs
0bc7d402
LucasWilkinson fix
99ef9160
LucasWilkinson update
d27b7edf
MatthewBonanni Fix docs build
f5395e11
MatthewBonanni Update .gitignore
0cac3056
LucasWilkinson LucasWilkinson force pushed to 0cac3056 31 days ago
mergify mergify removed needs-rebase
LucasWilkinson Merge branch 'main' into lwilkinson/fa4-integration
23caed99
LucasWilkinson LucasWilkinson added ready
MatthewBonanni Merge branch 'main' into lwilkinson/fa4-integration
e67aff15
MatthewBonanni FA4 doesn't support head sizes > 128
c84d443c
mergify
mergify mergify added needs-rebase
MatthewBonanni Merge branch 'main' into lwilkinson/fa4-integration
d9bdb068
mergify mergify removed needs-rebase
MatthewBonanni Fix cuda driver initialization
86a86d5b
MatthewBonanni Fix cudagraph dispatch
8240f9f1
mergify
mergify mergify added needs-rebase
MatthewBonanni Merge branch 'main' into lwilkinson/fa4-integration
346b7604
mergify mergify removed needs-rebase
LucasWilkinson Merge branch 'main' into lwilkinson/fa4-integration
f6bf305d
MatthewBonanni Update FA git tag
e4f5ddf1
mgoin
mgoin commented on 2026-02-11
LucasWilkinson update FA
c760b6fe
LucasWilkinson update dependencies
5fd8e7f0
LucasWilkinson review comments
4f966a61
LucasWilkinson Merge branch 'main' into lwilkinson/fa4-integration
ec47e3e9
LucasWilkinson Merge branch 'main' into lwilkinson/fa4-integration
5ecfcda7
MatthewBonanni Merge branch 'main' into lwilkinson/fa4-integration
371dae12
LucasWilkinson Merge branch 'main' into lwilkinson/fa4-integration
1a76b222
mgoin
mgoin approved these changes on 2026-02-17
tlrmchlsmth
tlrmchlsmth commented on 2026-02-17
tlrmchlsmth
tlrmchlsmth commented on 2026-02-17
tlrmchlsmth
tlrmchlsmth commented on 2026-02-17
tlrmchlsmth
tlrmchlsmth approved these changes on 2026-02-17
LucasWilkinson Update vllm/vllm_flash_attn/flash_attn_interface.py
3c98e9f7
LucasWilkinson Update vllm/vllm_flash_attn/flash_attn_interface.py
cae06ab2
LucasWilkinson Update vllm/vllm_flash_attn/flash_attn_interface.py
0e30cf09
LucasWilkinson review comments
9d96d2dc
LucasWilkinson Merge branch 'main' into lwilkinson/fa4-integration
4fd52ded
mergify
mergify mergify added needs-rebase
LucasWilkinson Merge remote-tracking branch 'origin/main' into lwilkinson/fa4-integr…
a0fa2932
LucasWilkinson LucasWilkinson enabled auto-merge (squash) 11 days ago
mergify mergify removed needs-rebase
PerkzZheng
LucasWilkinson Merge branch 'main' into lwilkinson/fa4-integration
f65a8a8d
LucasWilkinson Merge branch 'main' into lwilkinson/fa4-integration
49917fbe
LucasWilkinson LucasWilkinson requested a review from MatthewBonanni MatthewBonanni 10 days ago
LucasWilkinson lazy import
2fcbd3d8
LucasWilkinson Merge branch 'main' into lwilkinson/fa4-integration
87a40bca
mergify
mergify
mergify
LucasWilkinson fix(fa): lazy import FA3 to avoid hang on non-SM90 architectures
e5654b98
MatthewBonanni Exclude init
54469c7f
MatthewBonanni Comment
86c54339
MatthewBonanni Fix pre-commit
67d54f7c
MatthewBonanni MatthewBonanni force pushed from 477ee621 to 67d54f7c 8 days ago
MatthewBonanni Revert "fix(fa): lazy import FA3 to avoid hang on non-SM90 architectu…
0f8d6643
MatthewBonanni MatthewBonanni force pushed from 56adcd0a to 21030310 8 days ago
MatthewBonanni MatthewBonanni force pushed from 21030310 to cfeb84d0 7 days ago
MatthewBonanni MatthewBonanni force pushed from cfeb84d0 to a7a04711 7 days ago
MatthewBonanni MatthewBonanni force pushed from a7a04711 to a510fd9a 7 days ago
MatthewBonanni [TEMPORARY] add diagnostics
f29777e8
MatthewBonanni MatthewBonanni force pushed from a510fd9a to f29777e8 7 days ago
MatthewBonanni MatthewBonanni requested a review from njhill njhill 7 days ago
MatthewBonanni Revert "[TEMPORARY] add diagnostics"
9fb083c8
MatthewBonanni Use spawn
17a47a32
MatthewBonanni Add guard
9283442c
LucasWilkinson Merge branch 'main' into lwilkinson/fa4-integration
3a092735
LucasWilkinson Merge branch 'main' into lwilkinson/fa4-integration
14cface5
LucasWilkinson LucasWilkinson merged 8b5014d3 into main 5 days ago
LucasWilkinson

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
documentation ready ci/build v1 nvidia
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum