vllm
87baebeb - [Frontend][TPU] Add TPU default max-num-batched-tokens based on device name (#17508)
Commit
View On GitHub
Commit
222 days ago
[Frontend][TPU] Add TPU default max-num-batched-tokens based on device name (#17508) Signed-off-by: Chenyaaang <chenyangli@google.com>
Author
Chenyaaang Chenyaaang
Parents
e3d0a1d1
FAQ Terms Privacy Refunds Impressum
Loading