vllm
[Dynamic Spec Decoding] Minor fix for disabling speculative decoding
#5000
Merged

Commits
  • test and fix
    LiuXiaoxuanPKU committed 1 year ago
  • fix comments
    LiuXiaoxuanPKU committed 1 year ago
  • fix tests
    LiuXiaoxuanPKU committed 1 year ago
Loading