vllm
[6/N] HiSparse: add DeepSeek V4 support
#53592
Open
Overview
Commits
3
Changes
View On GitHub

[6/N] HiSparse: add DeepSeek V4 support #53592

MatthewBonanni wants to merge 3 commits into feat/nixl-host-read-staging from feat/hisparse-deepseek-v4
MatthewBonanni
mergify mergify added deepseek
mergify mergify added DSv4
mergify mergify added kv-cache-manager
MatthewBonanni MatthewBonanni force-pushed the feat/hisparse-metrics branch from 5bc90159 to d331ad01 5 days ago
MatthewBonanni MatthewBonanni force pushed from ac80aa4c to f48b9959 5 days ago
Base automatically changed from feat/hisparse-metrics to feat/nixl-host-read-staging 5 days ago
MatthewBonanni MatthewBonanni marked this pull request as ready for review 5 days ago
MatthewBonanni MatthewBonanni requested a review from zyongye zyongye 5 days ago
MatthewBonanni MatthewBonanni requested a review from WoosukKwon WoosukKwon 5 days ago
MatthewBonanni MatthewBonanni requested a review from robertgshaw2-redhat robertgshaw2-redhat 5 days ago
MatthewBonanni MatthewBonanni requested a review from njhill njhill 5 days ago
MatthewBonanni MatthewBonanni requested a review from ywang96 ywang96 5 days ago
MatthewBonanni MatthewBonanni requested a review from alexm-redhat alexm-redhat 5 days ago
MatthewBonanni MatthewBonanni requested a review from heheda12345 heheda12345 5 days ago
MatthewBonanni MatthewBonanni requested a review from ApostaC ApostaC 5 days ago
MatthewBonanni MatthewBonanni requested a review from orozery orozery 5 days ago
MatthewBonanni MatthewBonanni requested a review from ivanium ivanium 5 days ago
claude
claude commented on 2026-08-25
MatthewBonanni MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from 15cee6fe to 54d8c008 5 days ago
MatthewBonanni MatthewBonanni force pushed from f48b9959 to 650828f5 5 days ago
sonny-vleisides
MatthewBonanni MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from 54d8c008 to 43b9a431 4 days ago
MatthewBonanni MatthewBonanni requested a review from bigPYJ1151 bigPYJ1151 4 days ago
MatthewBonanni MatthewBonanni requested a review from xuechendi xuechendi 4 days ago
MatthewBonanni MatthewBonanni requested a review from mgoin mgoin 4 days ago
MatthewBonanni MatthewBonanni requested a review from tlrmchlsmth tlrmchlsmth 4 days ago
MatthewBonanni MatthewBonanni requested a review from yewentao256 yewentao256 4 days ago
MatthewBonanni MatthewBonanni requested a review from AndreasKaratzas AndreasKaratzas 4 days ago
MatthewBonanni MatthewBonanni requested a review from NickLucche NickLucche 4 days ago
MatthewBonanni MatthewBonanni requested a review from tdoublep tdoublep 4 days ago
MatthewBonanni MatthewBonanni requested a review from pavanimajety pavanimajety 4 days ago
MatthewBonanni MatthewBonanni requested a review from vadiklyutiy vadiklyutiy 4 days ago
MatthewBonanni MatthewBonanni requested a review from zhuohan123 zhuohan123 4 days ago
MatthewBonanni MatthewBonanni requested a review from youkaichao youkaichao 4 days ago
MatthewBonanni MatthewBonanni requested a review from LucasWilkinson LucasWilkinson 4 days ago
MatthewBonanni MatthewBonanni requested a review from houseroad houseroad 4 days ago
MatthewBonanni MatthewBonanni requested a review from ProExpertProg ProExpertProg 4 days ago
MatthewBonanni MatthewBonanni requested a review from Harry-Chen Harry-Chen 4 days ago
MatthewBonanni MatthewBonanni force pushed from 650828f5 to 7da37c61 4 days ago
mergify mergify added kv-connector
mergify mergify added nvidia
mergify mergify added speculative-decoding
mergify mergify added mrv2
MatthewBonanni MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from 43b9a431 to a8e6b043 4 days ago
MatthewBonanni MatthewBonanni force pushed from a5308b02 to 89750f90 4 days ago
MatthewBonanni MatthewBonanni force pushed from 89750f90 to 10cda83e 4 days ago
MatthewBonanni MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from a8e6b043 to 4f341703 4 days ago
MatthewBonanni MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from 4f341703 to 7ea5ecab 3 days ago
MatthewBonanni MatthewBonanni force pushed from 10cda83e to d7059e64 3 days ago
MatthewBonanni MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from 7ea5ecab to a9fa64fa 3 days ago
MatthewBonanni MatthewBonanni force pushed from d7059e64 to 4f2fdbc0 3 days ago
MatthewBonanni MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from a9fa64fa to 59b085ec 3 days ago
MatthewBonanni MatthewBonanni force pushed from 4f2fdbc0 to 9cabae34 3 days ago
MatthewBonanni MatthewBonanni force pushed from 9cabae34 to 91461b66 3 days ago
MatthewBonanni MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from 59b085ec to 4dee8795 3 days ago
MatthewBonanni MatthewBonanni force pushed from 91461b66 to 6dbfc153 3 days ago
MatthewBonanni MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from 4dee8795 to 52321518 3 days ago
MatthewBonanni MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from 52321518 to 61ad48e1 3 days ago
MatthewBonanni MatthewBonanni force pushed from 6dbfc153 to db97b21f 3 days ago
MatthewBonanni Add DeepSeek V4 HiSparse support
e444d1fb
MatthewBonanni Align DeepSeek V4 HiSparse layout test
f265c713
MatthewBonanni Restore Triton imports for HiSparse slot compression
065d658e
MatthewBonanni MatthewBonanni force-pushed the feat/nixl-host-read-staging branch from 61ad48e1 to dfc3f675 2 days ago
MatthewBonanni MatthewBonanni force pushed from db97b21f to 065d658e 2 days ago
Rugu7

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
speculative-decoding deepseek kv-connector nvidia mrv2 DSv4 kv-cache-manager
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum