vllm
bc8ed3c4 - [V1][Spec Decode] Use better defaults for N-gram (#15358)

Commit

271 days ago

[V1][Spec Decode] Use better defaults for N-gram (#15358) Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

References

Author

WoosukKwon

Parents