vllm
[Attention Backend] TurboQuant: 2-bit KV cache compression with 4x capacity
#38479
Merged
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
10
Changes
View On
GitHub
Loading