vllm
Let max_num_batched_tokens use human_readable_int for large numbers
#18968
Merged
Merged
Let max_num_batched_tokens use human_readable_int for large numbers #18968
DarkLight1337
merged
1 commit into
vllm-project:main
from
neuralmagic:add-max_num_batched_tokens-human_readable_int
Let max_num_batched_tokens use human_readable_int for large numbers
1d4b8423
houseroad
approved these changes
on 2025-05-31
Login to write a write a comment.
Login via GitHub