vllm
[Attention] relax the head dim 512 and paged kv for sm90+FA4
#38835

Merged

[Attention] relax the head dim 512 and paged kv for sm90+FA4 #38835

LucasWilkinson merged 10 commits into vllm-project:main from IwakuraRein:update-sm90-fa4

IwakuraRein requested a review from

LucasWilkinson 38 days ago

IwakuraRein requested a review from

MatthewBonanni 38 days ago

mergify added v1

IwakuraRein changed the title ~~relax the head dim 512 and paged kv for sm90+FA4~~ [Attention] relax the head dim 512 and paged kv for sm90+FA4 38 days ago

gemini-code-assist commented on 2026-04-02

mergify added ci/build

relax the head dim 512 and paged kv for sm90+FA4

f38f4fde

mergify added needs-rebase

update the vllm-flash-attn commit

75ea3b36

IwakuraRein force pushed to 75ea3b36 38 days ago

mergify removed needs-rebase

update vllm-flash-attn git repo; TODO: revert after the vllm-flash-at…

5527ed33

Advertise head_dim 512 support when FA4 is available and force FA4 fo…

694930b5

point vllm-flash-attn to ToT

b04cdd20

LucasWilkinson approved these changes on 2026-04-03

LucasWilkinson added ready

LucasWilkinson enabled auto-merge (squash) 36 days ago