vllm
[ROCm] Add AMD GPU support on Deepseek v3.2 and SparseMLA
#26670
Merged
Overview
Commits
9
Changes
View On GitHub

[ROCm] Add AMD GPU support on Deepseek v3.2 and SparseMLA #26670

vllm-bot merged 9 commits into vllm-project:main from ROCm:ganyi/dsv3.2_rocm_support
ganyi1996ppo
ganyi1996ppo ganyi1996ppo requested a review from gshtras gshtras 241 days ago
ganyi1996ppo ganyi1996ppo requested a review from LucasWilkinson LucasWilkinson 241 days ago
ganyi1996ppo ganyi1996ppo requested a review from WoosukKwon WoosukKwon 241 days ago
ganyi1996ppo ganyi1996ppo requested a review from robertgshaw2-redhat robertgshaw2-redhat 241 days ago
ganyi1996ppo ganyi1996ppo requested a review from njhill njhill 241 days ago
ganyi1996ppo ganyi1996ppo requested a review from ywang96 ywang96 241 days ago
ganyi1996ppo ganyi1996ppo requested a review from comaniac comaniac 241 days ago
ganyi1996ppo ganyi1996ppo requested a review from alexm-redhat alexm-redhat 241 days ago
mergify mergify added deepseek
mergify mergify added rocm
mergify mergify added v1
gemini-code-assist
gemini-code-assist commented on 2025-10-13
chatgpt-codex-connector
chatgpt-codex-connector commented on 2025-10-13
HAIAI HAIAI assigned HAIAI HAIAI 240 days ago
HAIAI HAIAI requested a review from HAIAI HAIAI 240 days ago
HAIAI
HAIAI requested changes on 2025-10-13
HAIAI
HAIAI requested changes on 2025-10-16
mergify
mergify mergify added needs-rebase
SageMoore
SageMoore commented on 2025-10-16
tjtanaa
tjtanaa commented on 2025-10-20
ganyi1996ppo ganyi1996ppo force pushed from 60b33e04 to 8d436d73 233 days ago
ganyi1996ppo ganyi1996ppo requested a review from HAIAI HAIAI 233 days ago
mergify mergify removed needs-rebase
ganyi1996ppo
ganyi1996ppo ganyi1996ppo requested a review from SageMoore SageMoore 233 days ago
ganyi1996ppo ganyi1996ppo requested a review from tjtanaa tjtanaa 233 days ago
SageMoore
SageMoore commented on 2025-10-21
rasmith
rasmith commented on 2025-10-21
ganyi1996ppo ganyi1996ppo requested a review from sighingnow sighingnow 232 days ago
ganyi1996ppo ganyi1996ppo requested a review from mgoin mgoin 232 days ago
ganyi1996ppo ganyi1996ppo requested a review from tlrmchlsmth tlrmchlsmth 232 days ago
ganyi1996ppo ganyi1996ppo requested a review from yewentao256 yewentao256 232 days ago
ganyi1996ppo ganyi1996ppo requested a review from 22quinn 22quinn 232 days ago
ganyi1996ppo ganyi1996ppo requested a review from houseroad houseroad 232 days ago
ganyi1996ppo ganyi1996ppo requested a review from pavanimajety pavanimajety 232 days ago
ganyi1996ppo ganyi1996ppo requested a review from zou3519 zou3519 232 days ago
ganyi1996ppo ganyi1996ppo requested a review from youkaichao youkaichao 232 days ago
ganyi1996ppo ganyi1996ppo requested a review from ProExpertProg ProExpertProg 232 days ago
mergify
mergify mergify added documentation
mergify mergify added ci/build
mergify mergify added performance
mergify mergify added qwen
mergify mergify added speculative-decoding
mergify
mergify mergify added needs-rebase
ganyi1996ppo ganyi1996ppo force pushed from 3115fa5a 232 days ago
mergify mergify removed needs-rebase
gshtras
gshtras commented on 2025-10-22
divakar-amd
divakar-amd commented on 2025-10-24
ganyi1996ppo ganyi1996ppo force pushed 227 days ago
ganyi1996ppo ganyi1996ppo requested a review from gshtras gshtras 226 days ago
ganyi1996ppo ganyi1996ppo force pushed to debc8fbc 226 days ago
ganyi1996ppo ganyi1996ppo force pushed 223 days ago
wuhuikx
wuhuikx approved these changes on 2025-10-31
ganyi1996ppo
wuhuikx
tjtanaa
tjtanaa
tjtanaa commented on 2025-11-11
mergify
mergify mergify added needs-rebase
tjtanaa
tjtanaa commented on 2025-11-11
tjtanaa
tjtanaa commented on 2025-11-11
tjtanaa
tjtanaa commented on 2025-11-11
tjtanaa
tjtanaa commented on 2025-11-11
tjtanaa
tjtanaa commented on 2025-11-11
tjtanaa
tjtanaa commented on 2025-11-11
tjtanaa
ganyi1996ppo
ganyi1996ppo ganyi1996ppo force pushed 209 days ago
mergify mergify removed needs-rebase
ganyi1996ppo ganyi1996ppo force pushed 209 days ago
ganyi1996ppo
tjtanaa
tjtanaa
tjtanaa commented on 2025-11-15
ganyi1996ppo ganyi1996ppo force pushed 205 days ago
tjtanaa
tjtanaa commented on 2025-11-18
tjtanaa
tjtanaa commented on 2025-11-18
tjtanaa
tjtanaa commented on 2025-11-18
tjtanaa
tjtanaa tjtanaa added ready
tjtanaa
tjtanaa approved these changes on 2025-11-18
tjtanaa tjtanaa enabled auto-merge (squash) 204 days ago
tjtanaa
disabled auto-merge 204 days ago
Head branch was pushed to by a user without write access
ganyi1996ppo ganyi1996ppo force pushed to 99df437a 204 days ago
tjtanaa
ganyi1996ppo
ganyi1996ppo deepseekv3.2 support for rocm platform
abf85c41
ganyi1996ppo adopt in sparse mla backend, and add ref path to mqa logits
8fdafbc2
ganyi1996ppo fix lint
f6dd0c8b
ganyi1996ppo make indexer support block-size 1 if platform is rocm
e684acb8
ganyi1996ppo add assertion for block-size in SparseMLA and fix pa_mqa import bug
100f9652
ganyi1996ppo add lru cache on module check
68882cc3
ganyi1996ppo add comments
406fbdb2
ganyi1996ppo remove paged_mqa_logits module check
acec7719
ganyi1996ppo ganyi1996ppo force pushed to acec7719 203 days ago
ganyi1996ppo Merge branch 'main' into ganyi/dsv3.2_rocm_support
47c64db1
vllm-bot vllm-bot merged 06c20c99 into main 202 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
Labels
documentation performance rocm speculative-decoding ready ci/build v1 qwen deepseek
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum