vllm
[Attention Backend] TurboQuant: 2-bit KV cache compression with 4x capacity
#38479
Merged
Overview
Commits
10
Changes
View On GitHub

[Attention Backend] TurboQuant: 2-bit KV cache compression with 4x capacity #38479

vllm-bot merged 10 commits into vllm-project:main from vibhavagarwal5:feature/turboquant-kv-cache
vibhavagarwal5
vibhavagarwal5 vibhavagarwal5 requested a review from LucasWilkinson LucasWilkinson 127 days ago
vibhavagarwal5 vibhavagarwal5 requested a review from MatthewBonanni MatthewBonanni 127 days ago
vibhavagarwal5 vibhavagarwal5 requested a review from heheda12345 heheda12345 127 days ago
claude
claude commented on 2026-03-29
github-actions
mergify mergify added nvidia
mergify mergify added v1
gemini-code-assist
gemini-code-assist commented on 2026-03-29
HelloWorldU
mergify
mergify mergify added needs-rebase
mergify mergify removed needs-rebase
mgoin
mgoin
mgoin
mgoin commented on 2026-03-30
Sggin1
tjtanaa
huangzhilin-hzl
MidasMining
Alberto-Codes
MidasMining
Alberto-Codes
Cklaus1
yangyang-cs95
yangyang-cs95 commented on 2026-04-02
yangyang-cs95
yangyang-cs95 commented on 2026-04-02
yangyang-cs95
yangyang-cs95 commented on 2026-04-02
varjoranta
vibhavagarwal5
varjoranta
varjoranta
mergify
mergify mergify added needs-rebase
mergify mergify removed needs-rebase
Cklaus1
vibhavagarwal5
vibhavagarwal5
vibhavagarwal5 vibhavagarwal5 requested a review from robertgshaw2-redhat robertgshaw2-redhat 121 days ago
vibhavagarwal5 vibhavagarwal5 requested a review from tlrmchlsmth tlrmchlsmth 121 days ago
vibhavagarwal5 vibhavagarwal5 requested a review from yewentao256 yewentao256 121 days ago
vibhavagarwal5 vibhavagarwal5 requested a review from pavanimajety pavanimajety 121 days ago
Alberto-Codes
varjoranta
vibhavagarwal5
gaby
gaby
Alberto-Codes
Alberto-Codes
gaby
vibhavagarwal5
wizzense
vibhavagarwal5
vibhavagarwal5
wizzense
vibhavagarwal5 vibhavagarwal5 force pushed to 4a9f0a66 120 days ago
vibhavagarwal5 vibhavagarwal5 force pushed from f698129c 120 days ago
vibhavagarwal5 vibhavagarwal5 requested a review from tjtanaa tjtanaa 120 days ago
vibhavagarwal5 vibhavagarwal5 requested a review from ZJY0516 ZJY0516 120 days ago
vibhavagarwal5 vibhavagarwal5 requested a review from vadiklyutiy vadiklyutiy 120 days ago
vibhavagarwal5 vibhavagarwal5 requested a review from WoosukKwon WoosukKwon 120 days ago
vibhavagarwal5 vibhavagarwal5 requested a review from youkaichao youkaichao 120 days ago
vibhavagarwal5 vibhavagarwal5 requested a review from houseroad houseroad 120 days ago
vibhavagarwal5 vibhavagarwal5 requested a review from hmellor hmellor 120 days ago
vibhavagarwal5 vibhavagarwal5 requested a review from ProExpertProg ProExpertProg 120 days ago
mergify mergify added ci/build
mergify mergify added rocm
vibhavagarwal5 vibhavagarwal5 force pushed to f698129c 120 days ago
gaby
Alberto-Codes
vibhavagarwal5
gaby
vibhavagarwal5
Alberto-Codes
Alberto-Codes
gaby
tianchongchong
mgoin
mgoin commented on 2026-04-04
gaby
Alberto-Codes
gaby
vibhavagarwal5
Alberto-Codes
Alberto-Codes
Alberto-Codes
vibhavagarwal5
MidasMining
Alberto-Codes
jagmarques
varjoranta
jagmarques
mgoin
mgoin commented on 2026-04-08
gaby
vibhavagarwal5
gaby
vibhavagarwal5
gaby
vibhavagarwal5
JianDan0212
vibhavagarwal5 vibhavagarwal5 requested a review from njhill njhill 117 days ago
vibhavagarwal5 vibhavagarwal5 requested a review from ywang96 ywang96 117 days ago
vibhavagarwal5 vibhavagarwal5 requested a review from alexm-redhat alexm-redhat 117 days ago
vibhavagarwal5 vibhavagarwal5 requested a review from ApostaC ApostaC 117 days ago
vibhavagarwal5 vibhavagarwal5 requested a review from orozery orozery 117 days ago
gaby
vibhavagarwal5
MidasMining
vibhavagarwal5
gaby
brucechanglongxu
vibhavagarwal5
vipin-sa-16319
MidasMining
vibhavagarwal5
MidasMining
vibhavagarwal5
Alberto-Codes
Alberto-Codes
MidasMining
Alberto-Codes
vipin-sa-16319
vibhavagarwal5
domvox
jagmarques
mgoin
mgoin commented on 2026-04-10
mgoin mgoin added ready
mgoin mgoin added quantization
mergify
mergify
mergify
mergify
vibhavagarwal5 feat: add TurboQuant KV cache attention backend
ad529414
vibhavagarwal5 refactor: integrate TurboQuant into vLLM engine and model config
a30debb8
vibhavagarwal5 test: add TurboQuant unit tests and GSM8K eval configs
2105b9ab
vibhavagarwal5 chore: add benchmark/eval tooling
297cd122
vibhavagarwal5 vibhavagarwal5 force pushed to 297cd122 114 days ago
mergify
mergify mergify added documentation
vibhavagarwal5
varjoranta
lishunyang12
lishunyang12 commented on 2026-04-11
lishunyang12
lishunyang12 commented on 2026-04-11
lishunyang12
lishunyang12 commented on 2026-04-11
lishunyang12
lishunyang12 commented on 2026-04-11
lishunyang12
lishunyang12 commented on 2026-04-11
lishunyang12
lishunyang12 commented on 2026-04-11
vibhavagarwal5 Merge branch 'main' into feature/turboquant-kv-cache
43382f3f
mergify
xinyu-intel turboquant attn on xpu (#5)
a8d08c6b
vibhavagarwal5 vibhavagarwal5 requested a review from jikunshang jikunshang 113 days ago
mergify mergify added intel-gpu
mgoin
mgoin approved these changes on 2026-04-13
brisker
vibhavagarwal5
gaby
mergify
vibhavagarwal5
vibhavagarwal5 addressed mgoin's and lishunyang12's comments
de371fe3
vibhavagarwal5 vibhavagarwal5 force pushed 111 days ago
mergify
vibhavagarwal5 pre-commit fix
59780c22
vibhavagarwal5 vibhavagarwal5 force pushed to 59780c22 111 days ago
mergify
vibhavagarwal5 CI bug fix, pre-commit fix
1305fcbe
mergify
mergify mergify added needs-rebase
mgoin Merge branch 'main' into feature/turboquant-kv-cache
ac46a983
mergify mergify removed needs-rebase
mgoin
mgoin approved these changes on 2026-04-15
vllm-bot vllm-bot merged f4b42df0 into main 111 days ago
naroam1
lishunyang12
xyehya
gaby
xyehya
siddharthjthapa
TheTom
xyehya
snailwei
seasoncool
gaby

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
documentation rocm intel-gpu ready ci/build v1 nvidia quantization
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum