Propagate vLLM batch size controls #588
expose vLLM batch size control config
718cbec5
comments
65379afd
type casting
33fc419e
bump
c63a5e2f
fix defaults
c3a510b7
NathanHB
approved these changes
on 2025-03-24
NathanHB
merged
bbbdd225
into main 1 year ago
alvin319
deleted the vllm-batch-size-control branch 1 year ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub