vllm
[Model loader]: support multi-thread model weight loading
#23928

Merged

Commits

[Model loader]: support multi-thread model weight loading

BraveY committed 332 days ago
Merge branch 'main' into comm/multi-thread-loading

BraveY committed 332 days ago
Merge branch 'main' into comm/multi-thread-loading

simon-mo committed 332 days ago
Merge branch 'main' into comm/multi-thread-loading

simon-mo committed 328 days ago