vllm
999dfc16 - [Bugfix] Offload blocking tokenizer ops to shared thread pool to unblock event loop (#34789)

Commit
18 days ago
[Bugfix] Offload blocking tokenizer ops to shared thread pool to unblock event loop (#34789) Signed-off-by: Bvicii <yizhanhuang2002@gmail.com> Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Author
Parents
Loading