vllm
[ROCm] [DSv4] [Perf] Support DeepSeek v4 MTP
#43385
Merged

[ROCm] [DSv4] [Perf] Support DeepSeek v4 MTP #43385

tjtanaa merged 9 commits into vllm-project:main from EmbeddedLLM:dsv4mtp
tjtanaa
tjtanaa support deepseek v4 mtp
93292d45
mergify mergify added deepseek
mergify mergify added gpt-oss
mergify mergify added rocm
mergify mergify added speculative-decoding
mergify mergify added v1
gemini-code-assist
gemini-code-assist commented on 2026-05-22
tjtanaa tjtanaa marked this pull request as ready for review 87 days ago
tjtanaa tjtanaa requested a review from zyongye zyongye 87 days ago
tjtanaa tjtanaa requested a review from benchislett benchislett 87 days ago
tjtanaa tjtanaa requested a review from luccafong luccafong 87 days ago
tjtanaa tjtanaa requested a review from MatthewBonanni MatthewBonanni 87 days ago
tjtanaa tjtanaa requested a review from mgoin mgoin 87 days ago
tjtanaa tjtanaa requested a review from pavanimajety pavanimajety 87 days ago
mergify
tjtanaa
tjtanaa commented on 2026-05-22
tjtanaa tjtanaa added ready
mergify
tjtanaa fix precommit
4fec5ad6
tjtanaa revert changes to vllm/models/deepseek_v4/common/ops/cache_utils.py
45592aeb
tjtanaa retain the original import for cuda
6021cb89
tjtanaa Merge branch 'main' into dsv4mtp
01362473
mergify
mergify mergify added needs-rebase
tjtanaa Merge remote-tracking branch 'origin/main' into dsv4mtp
4f37798c
tjtanaa Merge branch 'dsv4mtp' of https://github.com/EmbeddedLLM/vllm into ds…
81ea3b0e
tjtanaa tjtanaa requested a review from dllehr-amd dllehr-amd 86 days ago
mergify mergify removed needs-rebase
tjtanaa tjtanaa marked this pull request as draft 86 days ago
tjtanaa fix bug after sync with main
9ea242bd
tjtanaa tjtanaa marked this pull request as ready for review 86 days ago
tjtanaa
tjtanaa commented on 2026-05-23
tjtanaa
tjtanaa commented on 2026-05-23
zyongye
zyongye approved these changes on 2026-05-24
zyongye
tjtanaa
tjtanaa Merge remote-tracking branch 'origin/main' into dsv4mtp
27e11cd5
tjtanaa tjtanaa merged 1806d1ad into main 85 days ago
tjtanaa

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone