PR #53592 [8/N] HiSparse: add DeepSeek V4 support

[8/N] HiSparse: add DeepSeek V4 support #53592

MatthewBonanni wants to merge 8 commits into feat/nixl-host-read-staging from feat/hisparse-deepseek-v4

mergify added deepseek

mergify added DSv4

mergify added kv-cache-manager

MatthewBonanni force-pushed the feat/hisparse-metrics branch from 5bc90159 to d331ad01 53 days ago

MatthewBonanni force pushed from ac80aa4c 53 days ago

Base automatically changed from feat/hisparse-metrics to feat/nixl-host-read-staging 53 days ago

MatthewBonanni marked this pull request as ready for review 53 days ago

MatthewBonanni requested a review from

zyongye 53 days ago

MatthewBonanni requested a review from

WoosukKwon 53 days ago

MatthewBonanni requested a review from

robertgshaw2-redhat 53 days ago

MatthewBonanni requested a review from

njhill 53 days ago

MatthewBonanni requested a review from

ywang96 53 days ago

MatthewBonanni requested a review from

alexm-redhat 53 days ago

MatthewBonanni requested a review from

heheda12345 53 days ago

MatthewBonanni requested a review from

ApostaC 53 days ago

MatthewBonanni requested a review from

orozery 53 days ago

MatthewBonanni requested a review from

ivanium 53 days ago

claude commented on 2026-08-25

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch to 54d8c008 53 days ago

MatthewBonanni force pushed to 650828f5 53 days ago

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from 54d8c008 52 days ago

MatthewBonanni requested a review from

bigPYJ1151 52 days ago

MatthewBonanni requested a review from

xuechendi 52 days ago

MatthewBonanni requested a review from

mgoin 52 days ago

MatthewBonanni requested a review from

tlrmchlsmth 52 days ago

MatthewBonanni requested a review from

yewentao256 52 days ago

MatthewBonanni requested a review from

AndreasKaratzas 52 days ago

MatthewBonanni requested a review from

NickLucche 52 days ago

MatthewBonanni requested a review from

tdoublep 52 days ago

MatthewBonanni requested a review from

pavanimajety 52 days ago

MatthewBonanni requested a review from

vadiklyutiy 52 days ago

MatthewBonanni requested a review from

zhuohan123 52 days ago

MatthewBonanni requested a review from

youkaichao 52 days ago

MatthewBonanni requested a review from

LucasWilkinson 52 days ago

MatthewBonanni requested a review from

houseroad 52 days ago

MatthewBonanni requested a review from

ProExpertProg 52 days ago

MatthewBonanni requested a review from

Harry-Chen 52 days ago

MatthewBonanni force pushed from 650828f5 52 days ago

mergify added kv-connector

mergify added nvidia

mergify added speculative-decoding

mergify added mrv2

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch 52 days ago

MatthewBonanni force pushed 52 days ago

MatthewBonanni force pushed to 10cda83e 52 days ago

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch to 4f341703 52 days ago

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from 4f341703 to 7ea5ecab 51 days ago

MatthewBonanni force pushed from 10cda83e to d7059e64 51 days ago

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from 7ea5ecab to a9fa64fa 51 days ago

MatthewBonanni force pushed from d7059e64 to 4f2fdbc0 51 days ago

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from a9fa64fa to 59b085ec 51 days ago

MatthewBonanni force pushed from 4f2fdbc0 to 9cabae34 51 days ago

MatthewBonanni force pushed from 9cabae34 51 days ago

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from 59b085ec 51 days ago

MatthewBonanni force pushed to 6dbfc153 51 days ago

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch to 52321518 51 days ago

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from 52321518 to 61ad48e1 51 days ago

MatthewBonanni force pushed from 6dbfc153 to db97b21f 51 days ago

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from 61ad48e1 to dfc3f675 51 days ago

MatthewBonanni force pushed from db97b21f to 065d658e 51 days ago

MatthewBonanni force pushed from 065d658e 44 days ago

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from dfc3f675 44 days ago

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch to 21a05d1b 44 days ago

MatthewBonanni force pushed to ea9b3165 44 days ago

MatthewBonanni changed the title ~~[6/N] HiSparse: add DeepSeek V4 support~~ [7/N] HiSparse: add DeepSeek V4 support 43 days ago

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from 0fe911e0 to 0c2e53ae 43 days ago

MatthewBonanni requested a review from

zou3519 43 days ago

MatthewBonanni requested a review from

BoyuanFeng 43 days ago

mergify added documentation

mergify added ci/build

mergify added glm

mergify added minimax

mergify added cpu

mergify added dflash

mergify added needs-rebase

mergify added scheduler

mergify added torch.compile

MatthewBonanni force pushed from 97fddc7e to 48334caa 43 days ago

mergify removed needs-rebase

coderabbitai commented on 2026-09-05

MatthewBonanni force pushed from 48334caa to 586ca408 43 days ago

coderabbitai commented on 2026-09-05

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from d0ce57a8 to 111d49da 41 days ago

MatthewBonanni force pushed from 586ca408 to a63e61ca 41 days ago

coderabbitai commented on 2026-09-06

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from 111d49da to abb4b1f1 41 days ago

MatthewBonanni force pushed from a63e61ca to e7b9c642 41 days ago

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from abb4b1f1 to 52ed0111 40 days ago

MatthewBonanni force pushed from e7b9c642 to 664ae43a 40 days ago

coderabbitai commented on 2026-09-07

MatthewBonanni force pushed from 664ae43a to ea9e9679 39 days ago

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from 52ed0111 to 16a8a033 39 days ago

MatthewBonanni changed the title ~~[7/N] HiSparse: add DeepSeek V4 support~~ [8/N] HiSparse: add DeepSeek V4 support 39 days ago

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from 16a8a033 39 days ago

MatthewBonanni force pushed from ea9e9679 39 days ago

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch 39 days ago

MatthewBonanni force pushed 39 days ago

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch 39 days ago

MatthewBonanni force pushed to 9561d6a0 39 days ago

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch to b13fe038 39 days ago

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from b13fe038 39 days ago

MatthewBonanni force pushed from 9561d6a0 39 days ago

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch to c7fb9ed1 39 days ago

MatthewBonanni force pushed to 4eabd074 39 days ago

MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from c7fb9ed1 to 0b5b87f8 36 days ago

MatthewBonanni force pushed from 4eabd074 to cd767e17 36 days ago

Add DeepSeek V4 HiSparse support

c59bf0d0

Align DeepSeek V4 HiSparse layout test

27f64d40

Restore Triton imports for HiSparse slot compression

b70960b1

refactor(hisparse): drop obsolete layered backup path

8ea4ad79

Adapt DeepSeek V4 to shared HiSparse runtime APIs

6f56b3d8

Validate HiSparse cache row contiguity

bf5f3220

Use shared HiSparse decode batch predicate

7d3915c3

Exercise DeepSeek V4 layout through current HiSparse config builder

d22f72c1

LucasWilkinson force-pushed the feat/nixl-host-read-staging branch from 0b5b87f8 to 90e6fb03 36 days ago

LucasWilkinson force pushed from cd767e17 to d22f72c1 36 days ago

Reviewers

coderabbitai

claude

zyongye

WoosukKwon

robertgshaw2-redhat

njhill

ywang96

alexm-redhat

heheda12345

ApostaC

orozery

ivanium

bigPYJ1151

xuechendi

mgoin

tlrmchlsmth

yewentao256

AndreasKaratzas

NickLucche

tdoublep

pavanimajety

vadiklyutiy

zhuohan123

youkaichao

LucasWilkinson

houseroad

ProExpertProg

Harry-Chen

zou3519

BoyuanFeng

Assignees

No one assigned

Labels

documentation speculative-decoding torch.compile ci/build deepseek cpu kv-connector nvidia mrv2 DSv4 dflash scheduler kv-cache-manager glm minimax

Milestone

No milestone

vllm [8/N] HiSparse: add DeepSeek V4 support #53592 Open

[8/N] HiSparse: add DeepSeek V4 support #53592

vllm
[8/N] HiSparse: add DeepSeek V4 support
#53592

Open