vllm-project/vllm

Pull Requests Commits

[HiSparse] Expose cache metrics via KV connector stats

LucasWilkinson committed 6 days ago

80025ba0

[KV Connector] Generalize declarative connector stats

LucasWilkinson committed 6 days ago

51162f42

Fix HiSparse CUDA and E2E test fixtures

MatthewBonanni committed 6 days ago

f3d4fa23

Fix MLA cache spec test expectations

MatthewBonanni committed 6 days ago

a46bd886

Fix HiSparse connector CI fixtures

MatthewBonanni committed 6 days ago

9084aaee

Propagate replay boundaries through HiSparse caching

MatthewBonanni committed 6 days ago

cb443699

Initialize shared NIXL region test mapping

MatthewBonanni committed 6 days ago

0394efd3

Update FlashInfer warmup test for HiSparse

MatthewBonanni committed 6 days ago

03851418

Restore mixed-memory descriptor cache initialization

MatthewBonanni committed 6 days ago

e07675d5

Require HMA for HiSparse

MatthewBonanni committed 6 days ago

3104762d

Clean up HiSparse connector lifecycle

MatthewBonanni committed 6 days ago

e420a7eb

Simplify NIXL receive failure accounting

MatthewBonanni committed 6 days ago

f636fe95

Remove redundant NIXL block size initialization

NickLucche committed 6 days ago

e9e80ca1

Update sparse FlashInfer scale test fixture

MatthewBonanni committed 6 days ago

0f3e7cdf

Drop inapplicable offloading layout case

MatthewBonanni committed 6 days ago

29de40cb

Complete runner selection test fixtures

MatthewBonanni committed 6 days ago

5a6997fe

Fix runner selection test fixture

MatthewBonanni committed 6 days ago

6049665f

Align HiSparse import capacity expectation

MatthewBonanni committed 6 days ago

71566c96

Fix HiSparse import capacity test setup

MatthewBonanni committed 6 days ago

2a5cac67

Prune redundant HiSparse tests

MatthewBonanni committed 6 days ago

f3888e5a

Submit HiSparse spills after each forward

MatthewBonanni committed 6 days ago

5ecad9d0

Bind HiSparse step state before forward

MatthewBonanni committed 6 days ago

c4402b86

Exclude HiSparse auxiliary groups from prefix matching

MatthewBonanni committed 6 days ago

1af088df

Harden HiSparse attention warmup paths

MatthewBonanni committed 6 days ago

20672a3f

Fix HiSparse cache pool bookkeeping

MatthewBonanni committed 6 days ago

cb0ea830

Coordinate NIXL transfer completion across workers

MatthewBonanni committed 6 days ago

ea56bbdc

Rebase HiSparse MLA decode onto current stack

MatthewBonanni committed 6 days ago

bd8bb1a9

Simplify HiSparse P/D host landing

MatthewBonanni committed 6 days ago

6e75000f

test(hisparse): align DMA tests with resident mirrors

MatthewBonanni committed 6 days ago

076fb796

fix(hisparse): isolate padded decode residency state

MatthewBonanni committed 6 days ago

7a240b6f

Older