vllm
[Perf][Spec Decode] Avoid per-step numpy allocation in prepare_next_t…
#41043

Merged

[Perf][Spec Decode] Avoid per-step numpy allocation in prepare_next_t… #41043

benchislett merged 2 commits into vllm-project:main from wangluochao902:fix-spec-decode-numpy-alloc

wangluochao902 requested a review from

benchislett 96 days ago

wangluochao902 requested a review from

luccafong 96 days ago

wangluochao902 requested a review from

MatthewBonanni 96 days ago

claude commented on 2026-04-27

mergify added speculative-decoding

mergify added v1

gemini-code-assist commented on 2026-04-27

wangluochao902 force pushed from de67268f to a9a8e290 96 days ago

benchislett commented on 2026-04-27

benchislett requested changes on 2026-04-27

[Perf][Spec Decode] Avoid per-step numpy allocation in prepare_next_t…

0597b7ea

wangluochao902 force pushed from a9a8e290 to 0597b7ea 96 days ago

wangluochao902 requested a review from

benchislett 96 days ago

benchislett commented on 2026-04-27

wangluochao902 requested a review from

benchislett 95 days ago

benchislett approved these changes on 2026-04-29

benchislett added ready

Merge branch 'main' into fix-spec-decode-numpy-alloc

3d75cfa5

benchislett enabled auto-merge (squash) 94 days ago

benchislett merged b58669cb into main 94 days ago

Reviewers

benchislett

claude

gemini-code-assist

luccafong

MatthewBonanni

Assignees

No one assigned

Labels

speculative-decoding ready v1

Milestone

No milestone