vllm
[P/D][Feature] Support kv_transfer_params for parallel sampling (n>1)
#38900
Open

Loading