vllm
1ff8d763 - Add HiSparse host-resident sparse MLA decode

Commit

3 days ago

Add HiSparse host-resident sparse MLA decode

References

#53263 - [5/N][KV Connector][NIXL] Stage host KV reads through device memory

#53592 - [6/N] HiSparse: add DeepSeek V4 support

#53781 - [3/N] HiSparse: host-resident sparse-MLA decode hot-buffering

#53782 - [4/N] Expose HiSparse cache metrics

Author

MatthewBonanni

MatthewBonanni

Committer

MatthewBonanni

MatthewBonanni

Parents

Loading