vllm
6d86fde0
- [Model Runner V2] Remove UvaBufferPool for cpu->gpu copy (#33055)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
7 days ago
[Model Runner V2] Remove UvaBufferPool for cpu->gpu copy (#33055) Signed-off-by: Woosuk Kwon <woosuk@inferact.ai> Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu> Co-authored-by: Nick Hill <nhill@redhat.com>
References
#33055 - [Model Runner V2] Remove UvaBufferPool for cpu->gpu copy
Author
WoosukKwon
Parents
510ed1e8
Loading