vllm-project/vllm

Pull Requests Commits

Support adaptive verification in FlashMLA Sparse

MatthewBonanni committed 24 days ago

218a55e9

Exercise DeepSeek V4 layout through current HiSparse config builder

MatthewBonanni committed 24 days ago

d22f72c1

Use shared HiSparse decode batch predicate

MatthewBonanni committed 24 days ago

7d3915c3

Validate HiSparse cache row contiguity

MatthewBonanni committed 24 days ago

bf5f3220

Adapt DeepSeek V4 to shared HiSparse runtime APIs

MatthewBonanni committed 24 days ago

6f56b3d8

refactor(hisparse): drop obsolete layered backup path

MatthewBonanni committed 24 days ago

8ea4ad79

Restore Triton imports for HiSparse slot compression

MatthewBonanni committed 24 days ago

b70960b1

Align DeepSeek V4 HiSparse layout test

MatthewBonanni committed 24 days ago

27f64d40

Add DeepSeek V4 HiSparse support

MatthewBonanni committed 24 days ago

c59bf0d0

Preserve receive draining before reporting staged NIXL failures

MatthewBonanni committed 24 days ago

90e6fb03

Format restacked NIXL transfer completion path

MatthewBonanni committed 24 days ago

2a5fbec9

Report staged NIXL receive failures promptly

MatthewBonanni committed 24 days ago

d5a8e4e8

Fix staged NIXL transfer completion mode

MatthewBonanni committed 24 days ago

a5d57e2f

Preserve host-staging receive contract

MatthewBonanni committed 24 days ago

5152456b

Simplify staged receive failure coordination

MatthewBonanni committed 24 days ago

ebd1b871

Update mixed receive fixture for host staging

MatthewBonanni committed 24 days ago

a0a7be07

Keep empty NIXL reads on notify-only path

MatthewBonanni committed 24 days ago

e9d452d9

Preserve empty NIXL receive completion

MatthewBonanni committed 24 days ago

fb0ddee5

Gate NIXL host write staging to CUDA

MatthewBonanni committed 24 days ago

96a71a16

Stage mixed HiSparse host imports through GPU

MatthewBonanni committed 24 days ago

bfec845e

Prepare HiSparse row mappings before forward

MatthewBonanni committed 24 days ago

73a3a1e8

Fix HiSparse NIXL host pool ownership

MatthewBonanni committed 24 days ago

aa4e5072

Rebase NIXL host staging onto adaptive landing

MatthewBonanni committed 24 days ago

53045536

Preserve staged transfer failure lifecycle

MatthewBonanni committed 24 days ago

34694b12

review comments

MatthewBonanni committed 24 days ago

32ed8d72

Trim NIXL host staging test scaffolding

MatthewBonanni committed 24 days ago

32a32a0b

Revert "Harden NIXL host staging initialization"

MatthewBonanni committed 24 days ago

fd526b2b

Harden NIXL host staging initialization

MatthewBonanni committed 24 days ago

edf1b7ec

Do not suppress NIXL shutdown errors

MatthewBonanni committed 24 days ago

e12f1d14

[NIXL] Simplify host-stager progress and shutdown (#53354)

LucasWilkinson committed 24 days ago

6e223384

Older