vllm
[4/N] Expose HiSparse cache metrics
#53782
Open

[4/N] Expose HiSparse cache metrics #53782

MatthewBonanni
MatthewBonanni MatthewBonanni requested a review from ApostaC ApostaC 6 days ago
MatthewBonanni MatthewBonanni requested a review from orozery orozery 6 days ago
MatthewBonanni MatthewBonanni requested a review from ivanium ivanium 6 days ago
MatthewBonanni MatthewBonanni requested a review from WoosukKwon WoosukKwon 6 days ago
MatthewBonanni MatthewBonanni requested a review from njhill njhill 6 days ago
MatthewBonanni MatthewBonanni requested a review from yewentao256 yewentao256 6 days ago
MatthewBonanni MatthewBonanni requested a review from robertgshaw2-redhat robertgshaw2-redhat 6 days ago
MatthewBonanni MatthewBonanni requested a review from ywang96 ywang96 6 days ago
MatthewBonanni MatthewBonanni requested a review from alexm-redhat alexm-redhat 6 days ago
MatthewBonanni MatthewBonanni requested a review from heheda12345 heheda12345 6 days ago
MatthewBonanni MatthewBonanni requested a review from NickLucche NickLucche 6 days ago
MatthewBonanni MatthewBonanni requested a review from xuechendi xuechendi 6 days ago
claude
claude commented on 2026-08-25
MatthewBonanni MatthewBonanni added kv-connector
MatthewBonanni MatthewBonanni added mrv2
MatthewBonanni MatthewBonanni added scheduler
mergify
mergify mergify added needs-rebase
MatthewBonanni MatthewBonanni force-pushed the feat/hisparse-mla-decode-main branch from c9ba12d9 to 44945127 5 days ago
MatthewBonanni MatthewBonanni requested a review from zyongye zyongye 5 days ago
MatthewBonanni MatthewBonanni requested a review from bigPYJ1151 bigPYJ1151 5 days ago
MatthewBonanni MatthewBonanni requested a review from mgoin mgoin 5 days ago
MatthewBonanni MatthewBonanni requested a review from tlrmchlsmth tlrmchlsmth 5 days ago
MatthewBonanni MatthewBonanni requested a review from AndreasKaratzas AndreasKaratzas 5 days ago
MatthewBonanni MatthewBonanni requested a review from tdoublep tdoublep 5 days ago
MatthewBonanni MatthewBonanni requested a review from pavanimajety pavanimajety 5 days ago
MatthewBonanni MatthewBonanni requested a review from vadiklyutiy vadiklyutiy 5 days ago
MatthewBonanni MatthewBonanni requested a review from zhuohan123 zhuohan123 5 days ago
MatthewBonanni MatthewBonanni requested a review from youkaichao youkaichao 5 days ago
MatthewBonanni MatthewBonanni requested a review from LucasWilkinson LucasWilkinson 5 days ago
MatthewBonanni MatthewBonanni requested a review from houseroad houseroad 5 days ago
MatthewBonanni MatthewBonanni requested a review from ProExpertProg ProExpertProg 5 days ago
MatthewBonanni MatthewBonanni requested a review from Harry-Chen Harry-Chen 5 days ago
MatthewBonanni MatthewBonanni force pushed from d331ad01 to f85d83bb 5 days ago
MatthewBonanni MatthewBonanni force pushed from f85d83bb to f02e72f4 5 days ago
MatthewBonanni MatthewBonanni force pushed from f02e72f4 to c200b942 5 days ago
depthfirst-app
depthfirst-app commented on 2026-08-26
mergify mergify removed needs-rebase
MatthewBonanni MatthewBonanni force-pushed the feat/hisparse-mla-decode-main branch from d466b6ed to 5c14d115 4 days ago
MatthewBonanni MatthewBonanni force pushed from c200b942 to 46e3a3df 4 days ago
MatthewBonanni MatthewBonanni force-pushed the feat/hisparse-mla-decode-main branch from 8e727dee to 81672cc6 4 days ago
MatthewBonanni MatthewBonanni force pushed from 46e3a3df to df99b8b5 4 days ago
MatthewBonanni MatthewBonanni force pushed from b396ae5c to 0fb295a5 4 days ago
MatthewBonanni MatthewBonanni force-pushed the feat/hisparse-mla-decode-main branch from dbd8e0d9 to de6b8af9 4 days ago
MatthewBonanni MatthewBonanni force pushed from 0fb295a5 to 77470d8f 4 days ago
MatthewBonanni MatthewBonanni force pushed from 77470d8f to 09d7f104 4 days ago
MatthewBonanni MatthewBonanni force pushed from 09d7f104 to 17d758fe 4 days ago
MatthewBonanni Expose HiSparse cache metrics
a7b09983
MatthewBonanni Fix HiSparse metrics collection
b9129173
MatthewBonanni Allocate HiSparse metrics staging on CPU
0fd78c2c
MatthewBonanni MatthewBonanni force pushed from 17d758fe to 0fd78c2c 4 days ago

Login to write a write a comment.

Login via GitHub