vllm
9804145c - [Model][Speculative Decoding] Expand DeepSeek MTP code to support k > n_predict (#13626)

Commit

285 days ago

[Model][Speculative Decoding] Expand DeepSeek MTP code to support k > n_predict (#13626) Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>

References

#13626 - [Model][Speculative Decoding] Expand DeepSeek MTP code to support k > n_predict

Author

benchislett

Parents

2e94b9cf

vllm 9804145c - [Model][Speculative Decoding] Expand DeepSeek MTP code to support k > n_predict (#13626)

vllm
9804145c - [Model][Speculative Decoding] Expand DeepSeek MTP code to support k > n_predict (#13626)