[V1][Core] Fix memory issue with logits & sampling #14508
ywang96
merged
23 commits into
vllm-project:main
from
ywang96:fix-memory
update
08e1311e
update
e93aa149
Merge branch 'vllm-project:main' into fix-memory
08f85bc5
add note
1ea2fa27
Merge branch 'vllm-project:main' into fix-memory
53b99c38
Merge branch 'main' into fix-memory
23ab4ce0
Merge branch 'vllm-project:main' into fix-memory
77946d0c
remove spec decode
18b6354f
Merge branch 'vllm-project:main' into fix-memory
a93cb877
Merge branch 'vllm-project:main' into fix-memory
58b3a395
Merge branch 'vllm-project:main' into fix-memory
1b04868d
bypass
1f688cbe
add fixme
19e66dc6
add try catch
1e017e4a
Merge branch 'main' into fix-memory
c6d39a5b
add bad_words
2bc44fbe
varun-sundar-rabindranath
commented
on 2025-03-09
Merge branch 'vllm-project:main' into fix-memory
8062d687
fix
6256bcfc
Merge branch 'vllm-project:main' into fix-memory
e52d22bd
Fix capture sizes
82c20b93
add assert
609d2e82
fix
ba08848f
WoosukKwon
commented
on 2025-03-10
WoosukKwon
approved these changes
on 2025-03-11
Merge branch 'vllm-project:main' into fix-memory
6d4f1f99
Assignees
No one assigned
Labels
ready
v1
Milestone
No milestone
Login to write a write a comment.
Login via GitHub