vllm
fix(ngram): sync ngram_gpu acceptance rate to match CPU
#44054
Open
Overview
Commits
2
Changes
View On GitHub

fix(ngram): sync ngram_gpu acceptance rate to match CPU #44054

shiyangyang2001-lgtm wants to merge 2 commits into vllm-project:main from shiyangyang2001-lgtm:my-NgramAR-fix-branch
shiyangyang2001-lgtm
shiyangyang2001-lgtm shiyangyang2001-lgtm requested a review from njhill njhill 4 days ago
github-actions
mergify mergify added v1
shiyangyang2001-lgtm shiyangyang2001-lgtm changed the title [ngram][sync] Fix ngram_gpu acceptance rate to match CPU ngram fix(ngram): sync ngram_gpu acceptance rate to match CPU 3 days ago
shiyangyang2001-lgtm [Bug] Fix `tests/distributed/test_elastic_ep.py - assert False` (#43…
86ee7752
shiyangyang2001-lgtm [Speculative Decoding] Trim draft tokens by valid count in _get_draft…
5d67a07e
shiyangyang2001-lgtm shiyangyang2001-lgtm force pushed from ef3f4894 to 5d67a07e 3 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
v1
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum