vllm
6f2f59f2
- [Misc][Spec Decode] support different load config for draft model (#34022)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
83 days ago
[Misc][Spec Decode] support different load config for draft model (#34022) Signed-off-by: zzhengkai <zzhengkai@devgpu049.ldc1.facebook.com> Co-authored-by: zzhengkai <zzhengkai@devgpu049.ldc1.facebook.com>
References
#34022 - [Misc][Spec Decode] support different load config for draft model
Author
ZhengkaiZ
Parents
bb2fc8b5
Loading