vllm
20e489ea - [V1][Spec Decode] Make eagle compatible with prefix caching. (#17137)

Commit

227 days ago

[V1][Spec Decode] Make eagle compatible with prefix caching. (#17137) Signed-off-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>

References

Author

LiuXiaoxuanPKU

Parents