[P/D][Feature] Support kv_transfer_params for parallel sampling (n>1) #38900
[Feature] Support kv_transfer_params for parallel sampling (n>1) in PD
d4c20efc
[Feature] Support kv_transfer_params for parallel sampling (n>1) in PD
0836848e
[Feature] Support kv_transfer_params for parallel sampling (n>1) in PD
b7482d87
[Feature] Support kv_transfer_params for parallel sampling (n>1) in PD
cc9a763e
[Feature] Support kv_transfer_params for parallel sampling (n>1) in PD
f4a096f7
[Feature] Support kv_transfer_params for parallel sampling (n>1) in PD
2eddc958
chaunceyjiang
marked this pull request as ready for review 2 days ago
[Feature] Support kv_transfer_params for parallel sampling (n>1) in PD
6e53cde0
Assignees
No one assigned
Labels
frontend
v1
kv-connector
Login to write a write a comment.
Login via GitHub