vllm
[Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling
#27145

Merged

[Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling #27145

noooop merged 47 commits into vllm-project:main from noooop:all_pooling_plus_chunked_prefill2

Support chunked prefill with ALL pooling

86c0f384

mergify added v1

gemini-code-assist commented on 2025-10-18

fix

6bd49f27

chatgpt-codex-connector commented on 2025-10-18

fix

44c6ee13

gemini-code-assist commented on 2025-10-18

fix

86f0868e

noooop changed the title ~~[Model][5/N] Improve all pooling task | Support chunked prefill with ALL pooling~~ [Model][3/N] Improve all pooling task | Support chunked prefill with ALL pooling 88 days ago

Update vllm/model_executor/layers/pooler.py

7c1d68d4

Update vllm/model_executor/layers/pooler.py

f9034156

gemini-code-assist commented on 2025-10-18

Update vllm/model_executor/layers/pooler.py

72df85d8

gemini-code-assist commented on 2025-10-18

noooop commented on 2025-10-18

fix deep copy

6b6e7a8b

fix

9aef3544

+ tests

d574b6c3

Merge branch 'main' into all_pooling_plus_chunked_prefill2

26351d74

gemini-code-assist commented on 2025-10-18

fix

5c4b13c9

noooop requested a review from

aarnphm 88 days ago

noooop requested a review from

chaunceyjiang 88 days ago

mergify added frontend

fix StepPooler

178ccd26

fix StepPooler

43291dbd

noooop changed the title ~~[Model][3/N] Improve all pooling task | Support chunked prefill with ALL pooling~~ [Model][4/N] Improve all pooling task | Support chunked prefill with ALL pooling 86 days ago

+ preempted_req

bb9a4ad7

noooop requested a review from

WoosukKwon 85 days ago

noooop requested a review from

robertgshaw2-redhat 85 days ago

noooop requested a review from

njhill 85 days ago

noooop requested a review from

ywang96 85 days ago

noooop requested a review from

comaniac 85 days ago

noooop requested a review from

alexm-redhat 85 days ago

noooop requested a review from

heheda12345 85 days ago

noooop requested a review from

ApostaC 85 days ago

Merge branch 'main' into all_pooling_plus_chunked_prefill2

08a0739b

noooop changed the title ~~[Model][4/N] Improve all pooling task | Support chunked prefill with ALL pooling~~ [Model][5/N] Improve all pooling task | Support chunked prefill with ALL pooling 84 days ago

mergify added needs-rebase

Merge branch 'main' into all_pooling_plus_chunked_prefill2

29b3d1d7

mergify removed needs-rebase

update

eea5f6c0

update

41ff486d

noooop changed the title ~~[Model][5/N] Improve all pooling task | Support chunked prefill with ALL pooling~~ [Model][-/N] Improve all pooling task | Support chunked prefill with ALL pooling 78 days ago

mergify added needs-rebase

noooop changed the title ~~[Model][-/N] Improve all pooling task | Support chunked prefill with ALL pooling~~ [Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling 64 days ago

Merge branch 'main' into all_pooling_plus_chunked_prefill2

70c0965a

mergify removed needs-rebase

update

e8f222e3

Merge branch 'main' into all_pooling_plus_chunked_prefill2

d78b2cfe

update

fb8197be

mergify added needs-rebase

conflicts

c985ceda

Merge branch 'main' into all_pooling_plus_chunked_prefill2

0235532e

mergify removed needs-rebase

update

2d7f0c7f

update

193e0494

noooop requested a review from

youkaichao 44 days ago

noooop requested a review from

mgoin 44 days ago

noooop requested a review from

tlrmchlsmth 44 days ago

noooop requested a review from

houseroad 44 days ago

noooop requested a review from

hmellor 44 days ago

noooop requested a review from

yewentao256 44 days ago

noooop requested a review from

ProExpertProg 44 days ago

fix

0da5b304

Merge branch 'main' into all_pooling_plus_chunked_prefill2

da00d3c5

noooop added ready

fix Terratorch

dc0127c8

noooop removed review request from

alexm-redhat 44 days ago

noooop removed review request from

robertgshaw2-redhat 44 days ago

noooop removed review request from

ywang96 44 days ago

noooop requested a review from

DarkLight1337 44 days ago

DarkLight1337 commented on 2025-12-01

hmellor commented on 2025-12-01

mergify added needs-rebase

noooop marked this pull request as draft 43 days ago

Merge branch 'main' into all_pooling_plus_chunked_prefill2

bcc66e5a

mergify removed needs-rebase

conflicts

1351cd6f

+ docs

2e1168b0

mergify added documentation

noooop marked this pull request as ready for review 43 days ago

Merge branch 'main' into all_pooling_plus_chunked_prefill2

bbe71130

chatgpt-codex-connector commented on 2025-12-02

noooop requested a review from

DarkLight1337 43 days ago

noooop marked this pull request as draft 41 days ago

Merge branch 'main' into all_pooling_plus_chunked_prefill2

cc92d0b5

+ PoolingParamsInternalStates

3373b90e

noooop commented on 2025-12-04

+ PoolingStates

42d2f498

Merge branch 'main' into all_pooling_plus_chunked_prefill2

e921aede

fix

011295c0

noooop marked this pull request as ready for review 41 days ago

Merge branch 'main' into all_pooling_plus_chunked_prefill2

3ea31446

chatgpt-codex-connector commented on 2025-12-04

DarkLight1337 commented on 2025-12-04

+ CachedRequestState.pooling_states

3716b1ea

noooop marked this pull request as draft 41 days ago

- Unnecessary modification

241b60b6

fix

367d6eb3

noooop commented on 2025-12-04

DarkLight1337 commented on 2025-12-04

num_scheduled_tokens_cpu

65c7910a

mergify added needs-rebase

Merge branch 'main' into all_pooling_plus_chunked_prefill2

63a47822

mergify removed needs-rebase

noooop marked this pull request as ready for review 41 days ago

update

43bf1efe

Merge branch 'main' into all_pooling_plus_chunked_prefill2

f7f320eb

chatgpt-codex-connector commented on 2025-12-04

noooop requested a review from

DarkLight1337 41 days ago

DarkLight1337 approved these changes on 2025-12-04

noooop enabled auto-merge (squash) 41 days ago

noooop merged 74c4d80c into main 41 days ago

noooop deleted the all_pooling_plus_chunked_prefill2 branch 41 days ago

Reviewers

DarkLight1337

chatgpt-codex-connector

hmellor

gemini-code-assist

aarnphm

chaunceyjiang

WoosukKwon

njhill

comaniac

heheda12345

ApostaC

youkaichao

mgoin

tlrmchlsmth

houseroad

yewentao256

ProExpertProg

Assignees

No one assigned

Labels

documentation frontend ready v1

Milestone

No milestone

vllm [Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling #27145 Merged

[Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling #27145

vllm
[Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling
#27145

Merged