vllm
999dfc16
- [Bugfix] Offload blocking tokenizer ops to shared thread pool to unblock event loop (#34789)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
18 days ago
[Bugfix] Offload blocking tokenizer ops to shared thread pool to unblock event loop (#34789) Signed-off-by: Bvicii <yizhanhuang2002@gmail.com> Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
References
#34789 - [Bugfix] Offload blocking tokenizer ops to shared thread pool to unblock event loop
Author
scyyh11
Parents
d8606012
Loading