vllm
[V1] Aggregate chunked prompt logprobs in model runner
#14875

Merged

[V1] Aggregate chunked prompt logprobs in model runner #14875

robertgshaw2-redhat merged 9 commits into vllm-project:main from njhill:agg-prompt-logprob-chunks

njhill requested a review from

WoosukKwon 281 days ago

njhill requested a review from

robertgshaw2-redhat 281 days ago

njhill requested a review from

ywang96 281 days ago

njhill requested a review from

comaniac 281 days ago

njhill requested a review from

alexm-redhat 281 days ago

mergify added v1

[V1] Aggregate prompt logprobs in model runner

0d450f8c

njhill changed the title ~~[V1] Aggregate prompt logprobs in model runner~~ [V1] Aggregate chunked prompt logprobs in model runner 281 days ago

njhill force pushed to 0d450f8c 281 days ago

njhill added ready

fix dtype

59e10c0a

Fix edge case

3a3deb1e

Merge remote-tracking branch 'refs/remotes/origin/main' into agg-prom…

34daab32

afeldman-nm requested changes on 2025-03-19

afeldman-nm approved these changes on 2025-03-20

mergify added needs-rebase

Merge remote-tracking branch 'origin/main' into agg-prompt-logprob-ch…

b9d1873e

mergify removed needs-rebase

add comment per review

931d7e4a

Merge remote-tracking branch 'origin/main' into agg-prompt-logprob-ch…

196f1a94

robertgshaw2-redhat commented on 2025-03-21

address review comments

fec79272

move LogprobsTensors construction to static method

acbbfc00

robertgshaw2-redhat approved these changes on 2025-03-24

robertgshaw2-redhat merged 3aee6573 into main 272 days ago

njhill deleted the agg-prompt-logprob-chunks branch 272 days ago

Reviewers

robertgshaw2-redhat

afeldman-nm

WoosukKwon

ywang96

comaniac

alexm-redhat

Assignees

No one assigned

Labels

ready v1

Milestone

No milestone

vllm [V1] Aggregate chunked prompt logprobs in model runner #14875 Merged

[V1] Aggregate chunked prompt logprobs in model runner #14875

vllm
[V1] Aggregate chunked prompt logprobs in model runner
#14875

Merged