vllm
[Performance Improvement] Update `batched_count_greater_than` to handle batch size 1 without recompile
#38933

Merged

[Performance Improvement] Update `batched_count_greater_than` to handle batch size 1 without recompile #38933

DarkLight1337 merged 3 commits into vllm-project:main from Lucaskabela:lucaskabela/improve_logprob_compile

mergify added v1

gemini-code-assist commented on 2026-04-03

Lucaskabela force pushed 54 days ago

Lucaskabela marked this pull request as ready for review 54 days ago

Lucaskabela requested a review from

22quinn 54 days ago

Lucaskabela requested a review from

houseroad 54 days ago

Lucaskabela requested a review from

njhill 54 days ago

Lucaskabela commented on 2026-04-03

laithsakka commented on 2026-04-03

laithsakka approved these changes on 2026-04-03

Update to handle batch size 0 without recompile

a287fdee

Lucaskabela force pushed to a287fdee 51 days ago

Merge branch 'main' into lucaskabela/improve_logprob_compile

f77a4a7b

ProExpertProg approved these changes on 2026-04-08

Merge branch 'main' into lucaskabela/improve_logprob_compile

f37acc1c

ProExpertProg added ready

ZJY0516 requested a review from

BoyuanFeng 49 days ago

ZJY0516 requested a review from

zou3519 49 days ago

DarkLight1337 merged a8c6ee9b into main 48 days ago

Lucaskabela deleted the lucaskabela/improve_logprob_compile branch 21 days ago

Reviewers

ProExpertProg

laithsakka

gemini-code-assist

22quinn

houseroad

njhill

BoyuanFeng

zou3519

Assignees

No one assigned

Labels

ready v1

Milestone

No milestone