vllm
8d6cf895 - [V1] [Spec Decode] Support random sampling for spec decode (#13933)

Commit

1 year ago

[V1] [Spec Decode] Support random sampling for spec decode (#13933) Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

References

Author

LiuXiaoxuanPKU

Parents