vllm
[PD][Nixl] Add support for hybrid SSM-FA models
#36687
Merged

[PD][Nixl] Add support for hybrid SSM-FA models #36687

NickLucche
mergify mergify added v1
mergify mergify added kv-connector
gemini-code-assist
gemini-code-assist commented on 2026-03-10
ZhanqiuHu
mergify
mergify mergify added needs-rebase
NickLucche NickLucche force pushed 87 days ago
NickLucche NickLucche marked this pull request as ready for review 87 days ago
NickLucche NickLucche requested a review from ApostaC ApostaC 87 days ago
NickLucche NickLucche requested a review from orozery orozery 87 days ago
NickLucche NickLucche requested a review from WoosukKwon WoosukKwon 87 days ago
NickLucche NickLucche requested a review from robertgshaw2-redhat robertgshaw2-redhat 87 days ago
NickLucche NickLucche requested a review from njhill njhill 87 days ago
NickLucche NickLucche requested a review from ywang96 ywang96 87 days ago
NickLucche NickLucche requested a review from alexm-redhat alexm-redhat 87 days ago
NickLucche NickLucche requested a review from heheda12345 heheda12345 87 days ago
mergify mergify removed needs-rebase
mergify
mergify
NickLucche
NickLucche commented on 2026-03-11
mergify
orozery
NickLucche
tdoublep
tdoublep commented on 2026-03-11
mergify
mergify mergify added needs-rebase
tdoublep
tdoublep commented on 2026-03-12
NickLucche hacking ssm
e46626af
NickLucche fix for dsv32
effaf1c3
NickLucche integration tests
a8e38b1f
NickLucche unit tests logical blocks
02189563
NickLucche precommit
2cdc16ee
NickLucche cleanup prints
700ec310
NickLucche trust-remote-code
144a4d50
NickLucche drop cruft
6aa0ae65
NickLucche cruft
1b3988e2
NickLucche toms review
ca1806fd
NickLucche NickLucche force pushed to ca1806fd 86 days ago
NickLucche
mergify
mergify mergify removed needs-rebase
NickLucche block len per layer cleanup
723ab1c4
NickLucche
ZhanqiuHu
ZhanqiuHu commented on 2026-03-12
mergify
ZhanqiuHu
tlrmchlsmth
tlrmchlsmth commented on 2026-03-12
NickLucche remote num_blocks fix in get_block_ids
aeda1a53
mergify
NickLucche hop over remote conv size for ssm
e89dcb26
mergify
NickLucche generalize FA num_blocks swap
fa91b3e4
mergify
NickLucche
NickLucche precommit
15065f5d
gemini-code-assist
gemini-code-assist commented on 2026-03-13
NickLucche NickLucche added ready
NickLucche fix page_size for flashattn
25ade8c8
NickLucche fix cross-layer page_size counting
99c4a218
NickLucche update tests to have matching kv cache config
38310924
NickLucche fix heterogeneous TP
e80bb2e8
NickLucche fix cross_layer blocks layout
bd365b15
NickLucche async scheduling issue
900225b0
NickLucche fix test
208d6c80
tlrmchlsmth
tlrmchlsmth approved these changes on 2026-03-16
NickLucche NickLucche merged f5c081d4 into main 82 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone