vllm
da329cc3 - [Bugfix] Fix speculative decoding for short_conv (LFM2) models (#50272)

Commit
67 days ago
[Bugfix] Fix speculative decoding for short_conv (LFM2) models (#50272) Signed-off-by: jens.luecke <jens.luecke@liquid.ai> Co-authored-by: Tonoken3 <sakamakismile@gmail.com> Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Author
Parents
Loading