vllm
[Frontend][TPU] Add TPU default max-num-batched-tokens based on device name
#17508

Merged

[Frontend][TPU] Add TPU default max-num-batched-tokens based on device name #17508

vllm-bot merged 3 commits into vllm-project:main from Chenyaaang:user-arg1

add tpu default max-num-batched-tokens

7e87ae00

mergify added needs-rebase

Merge remote-tracking branch 'origin/main' into user-arg1

afaca692

mergify removed needs-rebase

mgoin commented on 2025-05-01

implement tpu platform get_device_name

29aed04a

mergify added tpu

mgoin approved these changes on 2025-05-02

mgoin added ready

vllm-bot merged 87baebeb into main 1 year ago

Reviewers

mgoin

Assignees

No one assigned

Labels

tpu ready

Milestone

No milestone