vllm
5c538c37 - [V1][Bugfix][Spec Decode] Fix incorrect outputs in V1 speculative decoding due to batch indexing (#14645)

Commit

272 days ago

[V1][Bugfix][Spec Decode] Fix incorrect outputs in V1 speculative decoding due to batch indexing (#14645) Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>

References

#14645 - [V1][Bugfix][Spec Decode] Fix incorrect outputs in V1 speculative decoding due to batch indexing

Author

benchislett

Parents

e22ee1e7

vllm 5c538c37 - [V1][Bugfix][Spec Decode] Fix incorrect outputs in V1 speculative decoding due to batch indexing (#14645)

vllm
5c538c37 - [V1][Bugfix][Spec Decode] Fix incorrect outputs in V1 speculative decoding due to batch indexing (#14645)