vllm
[Frontend][TPU] Add TPU default max-num-batched-tokens based on device name
#17508
Merged
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
3
Changes
View On
GitHub
Loading