vllm
[Bugfix][Quantization] Don't reject fp8_e5m2 KV cache for non-fp8 quantized checkpoints
#45040
Merged
Overview
Commits
4
Changes
View On GitHub

[Bugfix][Quantization] Don't reject fp8_e5m2 KV cache for non-fp8 quantized checkpoints #45040

yewentao256 merged 4 commits into vllm-project:main from Sunt-ing:fix/39137-fp8-e5m2-kv-gate
Sunt-ing
Sunt-ing [Bugfix][Quantization] Don't reject fp8_e5m2 KV cache for non-fp8 qua…
975d33d9
Sunt-ing Sunt-ing requested a review from mgoin mgoin 54 days ago
Sunt-ing Sunt-ing requested a review from robertgshaw2-redhat robertgshaw2-redhat 54 days ago
Sunt-ing Sunt-ing requested a review from yewentao256 yewentao256 54 days ago
Sunt-ing Sunt-ing requested a review from pavanimajety pavanimajety 54 days ago
Sunt-ing Sunt-ing requested a review from zyongye zyongye 54 days ago
Sunt-ing Sunt-ing requested a review from AndreasKaratzas AndreasKaratzas 54 days ago
Sunt-ing Sunt-ing requested a review from LucasWilkinson LucasWilkinson 54 days ago
Sunt-ing Sunt-ing requested a review from MatthewBonanni MatthewBonanni 54 days ago
mergify mergify added bug
Sunt-ing
yewentao256
yewentao256 commented on 2026-06-17
Sunt-ing Inline single-use fp8_e5m2 KV scale check
d4c982a8
Sunt-ing
Sunt-ing [Bugfix][Attention] Fix mypy attr-defined on kv_cache_scheme access
f4de7853
Sunt-ing
yewentao256
yewentao256 approved these changes on 2026-06-18
yewentao256 yewentao256 added ready
mergify[bot] Merge branch 'main' into fix/39137-fp8-e5m2-kv-gate
79dd8828
Sunt-ing
yewentao256 yewentao256 merged 79ca54d2 into main 45 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
bug ready
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum