vllm
[Bugfix] Fix TP inference for Flex attention backend
#19657

Merged

[Bugfix] Fix TP inference for Flex attention backend #19657

Isotr0py merged 4 commits into vllm-project:main from Isotr0py:flex-tp

fix tp with flex attn

67199afd

disable compile for tp

55d41b71

Isotr0py requested a review from

WoosukKwon 209 days ago

Isotr0py requested a review from

robertgshaw2-redhat 209 days ago

Isotr0py requested a review from

njhill 209 days ago

Isotr0py requested a review from

ywang96 209 days ago

Isotr0py requested a review from

comaniac 209 days ago

Isotr0py requested a review from

alexm-redhat 209 days ago

gemini-code-assist commented on 2025-06-15

mergify added v1

mergify added tpu

gemini-code-assist commented on 2025-06-15

Isotr0py requested a review from

houseroad 209 days ago

houseroad commented on 2025-06-15

add engine core tp test

b4f110f6

check cpu num blocks as well

30b4f921

houseroad approved these changes on 2025-06-15

Isotr0py enabled auto-merge (squash) 208 days ago

github-actions added ready

Isotr0py merged 1173804d into main 208 days ago

Isotr0py deleted the flex-tp branch 208 days ago

Reviewers

houseroad

drisspg

gemini-code-assist

WoosukKwon

robertgshaw2-redhat

njhill

ywang96

comaniac

alexm-redhat

Assignees

No one assigned

Labels

tpu ready v1

Milestone

No milestone

vllm [Bugfix] Fix TP inference for Flex attention backend #19657 Merged

[Bugfix] Fix TP inference for Flex attention backend #19657

vllm
[Bugfix] Fix TP inference for Flex attention backend
#19657

Merged