PR #39418 [Bugfix][CT] Fix KV cache scale handling

[Bugfix][CT] Fix KV cache scale handling #39418

yewentao256 merged 7 commits into vllm-project:main from yiliu30:fix/compressed-tensors-kv-cache-scale-float

[BugFix] CompressedTensors: set _k_scale_float/_v_scale_float for KV …

63941d09

yiliu30 requested a review from

mgoin 38 days ago

yiliu30 requested a review from

robertgshaw2-redhat 38 days ago

yiliu30 requested a review from

tlrmchlsmth 38 days ago

yiliu30 requested a review from

yewentao256 38 days ago

yiliu30 requested a review from

pavanimajety 38 days ago

mergify added documentation

mergify added bug

yiliu30 changed the title ~~[BugFix] CompressedTensors: set _k_scale_float/_v_scale_float for KV cache quantization~~ [CT] set `_k_scale_float`/`_v_scale_float` for KV cache quantization 38 days ago

yiliu30 changed the title ~~[CT] set `_k_scale_float`/`_v_scale_float` for KV cache quantization~~ [CT] Fix KV cache scale handling 38 days ago

Merge branch 'main' into fix/compressed-tensors-kv-cache-scale-float

6fcc0c3b

add claude back

746f19e7

yiliu30 changed the title ~~[CT] Fix KV cache scale handling~~ [Bugfix][CT] Fix KV cache scale handling 37 days ago

mgoin approved these changes on 2026-04-10

mgoin added ready

mgoin added quantization

mgoin commented on 2026-04-10

fix

44f84ed6

fix

372e0be1

fix

ed7f74f0

Merge branch 'main' into fix/compressed-tensors-kv-cache-scale-float

ddd289da

hshen14 approved these changes on 2026-04-13

yewentao256 approved these changes on 2026-04-13

yewentao256 merged d8ddb316 into main 34 days ago

Reviewers

yewentao256

mgoin

hshen14

robertgshaw2-redhat

tlrmchlsmth

pavanimajety

Assignees

No one assigned

Labels

bug documentation ready quantization

Milestone

No milestone

vllm [Bugfix][CT] Fix KV cache scale handling #39418 Merged

[Bugfix][CT] Fix KV cache scale handling #39418

vllm
[Bugfix][CT] Fix KV cache scale handling
#39418

Merged