vllm
c4cb0af9 - [spec decode] Fix MTP inference path for MiMo-7B model (#25136)

Commit

169 days ago

[spec decode] Fix MTP inference path for MiMo-7B model (#25136) Signed-off-by: zixi-qi <qizixi@meta.com> Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

References

#25136 - [spec decode] Fix MTP inference path for MiMo-7B model

Author

zixi-qi

Parents

1c3b1634

vllm c4cb0af9 - [spec decode] Fix MTP inference path for MiMo-7B model (#25136)

vllm
c4cb0af9 - [spec decode] Fix MTP inference path for MiMo-7B model (#25136)