vllm
4df44c16 - Enable Eagle3 speculative decoding for Mistral3ForConditionalGeneration to support eagle3 (#33939)

Commit
71 days ago
Enable Eagle3 speculative decoding for Mistral3ForConditionalGeneration to support eagle3 (#33939) Signed-off-by: Akintunde Oladipo <akintunde.oladipo@servicenow.com> Signed-off-by: TundeAtSN <akintunde.oladipo@servicenow.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Author
Parents
Loading