vllm
[ROCm][DSv4] Functional fixes for DeepSeek V4 on MI300X/MI325X
#45681
Merged
Overview
Commits
26
Changes
View On GitHub

[ROCm][DSv4] Functional fixes for DeepSeek V4 on MI300X/MI325X #45681

tjtanaa merged 26 commits into vllm-project:main from tuukkjs:dsv4-rocm-mi300x-fixes
tuukkjs
ganyi1996ppo [ROCm][DSv4] MI300X (gfx942) support for DeepSeek V4
54084ea5
ganyi1996ppo [ROCm][DSv4] Use FNUZ FP8 on gfx942 in fused KV insert kernel
69146983
maeehart [ROCm][DSv4] Use tl.float8e4b8 for FNUZ on MI300X sparse MLA kernels
3b4a8eb7
maeehart [ROCm][DSv4] Zero ROCm sparse-MLA prefill KV workspace
b65601ef
jin-amd [ROCm][DSv4] Propagate FNUZ vs OCP gating to ROCm prefill+decode paths
f677c498
maeehart [ROCm][DSv4] Revert turboquant fp8e4b15 -> fp8e4b8 changes (NVIDIA-on…
54536ca5
maeehart [ROCm][DSv4][gfx942] Vendor fp8_mqa_logits kernel to avoid AITER upgrade
4da09192
maeehart [ROCm][DSv4] Use FNUZ FP8_MAX=224 to match vLLM convention (review #4…
f13e4450
maeehart [ROCm][DSv4] Tighten KV-workspace zero comment + FP8 encoding notes (…
9ae87030
tuukkjs Merge upstream main into PR #42893
84bc6bf4
tuukkjs Defer local HIP FP8 helper changes
fada012c
tuukkjs Allow 1 bf16 ULP in fused-kernel RoPE tests
6523058e
tuukkjs Remove sparse-MLA prefill workspace zeroing
56b26328
tuukkjs Fix full-cache FP8 parity tests for FNUZ
e914d642
tuukkjs Avoid typo lint in sparse decode comments
a095ceb6
mergify mergify added deepseek
mergify mergify added rocm
mergify mergify added v1
tuukkjs Trim sparse prefill workspace comment
22ec1168
tuukkjs tuukkjs force pushed from de244f55 to bb41eb97 41 days ago
tuukkjs Mark vendored fp8 MQA logits workaround
63e107f2
tuukkjs tuukkjs force pushed from bb41eb97 to 63e107f2 41 days ago
tuukkjs tuukkjs marked this pull request as ready for review 41 days ago
tuukkjs tuukkjs requested a review from tjtanaa tjtanaa 41 days ago
tuukkjs tuukkjs requested a review from AndreasKaratzas AndreasKaratzas 41 days ago
tuukkjs tuukkjs requested a review from dllehr-amd dllehr-amd 41 days ago
tuukkjs tuukkjs requested a review from zyongye zyongye 41 days ago
tuukkjs tuukkjs requested a review from mgoin mgoin 41 days ago
tuukkjs tuukkjs requested a review from tlrmchlsmth tlrmchlsmth 41 days ago
tuukkjs tuukkjs requested a review from WoosukKwon WoosukKwon 41 days ago
tuukkjs tuukkjs requested a review from yewentao256 yewentao256 41 days ago
tuukkjs tuukkjs requested a review from LucasWilkinson LucasWilkinson 41 days ago
tuukkjs tuukkjs requested a review from MatthewBonanni MatthewBonanni 41 days ago
tuukkjs tuukkjs requested a review from robertgshaw2-redhat robertgshaw2-redhat 41 days ago
tuukkjs tuukkjs requested a review from pavanimajety pavanimajety 41 days ago
tjtanaa
tjtanaa commented on 2026-06-16
tjtanaa
tjtanaa commented on 2026-06-16
tjtanaa
tjtanaa commented on 2026-06-16
tuukkjs Use FP8 range helper in DSv4 cache tests
30db2b29
tjtanaa
tjtanaa commented on 2026-06-17
tjtanaa
tjtanaa commented on 2026-06-17
tjtanaa
tjtanaa
tjtanaa commented on 2026-06-17
tjtanaa
tjtanaa commented on 2026-06-17
tuukkjs Simplify gfx942 fp8 MQA workaround comments
01bcc6e3
tuukkjs Gate DSv4 ROCm FP8 encoding on gfx942
b533f305
tuukkjs
tjtanaa
tjtanaa approved these changes on 2026-06-17
tjtanaa tjtanaa added ready
tjtanaa tjtanaa added DSv4
tjtanaa Merge branch 'main' into dsv4-rocm-mi300x-fixes
f39998c1
mergify
tjtanaa tjtanaa enabled auto-merge (squash) 39 days ago
mergify
tjtanaa Merge branch 'main' into dsv4-rocm-mi300x-fixes
ba7312af
mergify
tuukkjs Merge branch 'main' into dsv4-rocm-mi300x-fixes
4268c16d
mergify
tjtanaa Merge branch 'main' into dsv4-rocm-mi300x-fixes
465446c3
mergify
tjtanaa fix precommit module ambiguity
d4a61098
mergify
tjtanaa trying to resolve precommit
2ca9caaf
tjtanaa
tjtanaa commented on 2026-06-18
tjtanaa tjtanaa merged afdcbd5d into main 39 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
rocm ready v1 deepseek DSv4
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum