vllm
[Bugfix][Attention] Explicitly report support for kv_cache_dtype bfloat16
#32795

Merged

[Bugfix][Attention] Explicitly report support for kv_cache_dtype bfloat16 #32795

ProExpertProg merged 5 commits into vllm-project:main from MatthewBonanni:attn_bf16

Add bfloat16 explicitly

6e06067b

MatthewBonanni requested a review from

pavanimajety 33 days ago

MatthewBonanni changed the title ~~[Attention] Explicitly report support for kv_cache_dtype bfloat16~~ [Bugfix][Attention] Explicitly report support for kv_cache_dtype bfloat16 33 days ago

mergify added nvidia

mergify added v1

mergify added bug

gemini-code-assist commented on 2026-01-21

Update regular attention backends and base class

077fa118

MatthewBonanni requested a review from

tdoublep 33 days ago

MatthewBonanni requested a review from

mgoin 33 days ago

MatthewBonanni requested a review from

WoosukKwon 33 days ago

MatthewBonanni requested a review from

zhuohan123 33 days ago

MatthewBonanni requested a review from

youkaichao 33 days ago

MatthewBonanni requested a review from

alexm-redhat 33 days ago

MatthewBonanni requested a review from

njhill 33 days ago

MatthewBonanni requested a review from

LucasWilkinson 33 days ago

MatthewBonanni marked this pull request as draft 33 days ago

Fix references to auto

dae74fe0

mergify added cpu

MatthewBonanni marked this pull request as ready for review 33 days ago

MatthewBonanni requested a review from

bigPYJ1151 33 days ago

MatthewBonanni requested a review from

robertgshaw2-redhat 33 days ago

MatthewBonanni requested a review from

tlrmchlsmth 33 days ago

MatthewBonanni requested a review from

yewentao256 33 days ago

ProExpertProg approved these changes on 2026-01-22

Use is_quantized_kv_cache

dc7fce14

tlrmchlsmth approved these changes on 2026-01-22

ProExpertProg enabled auto-merge (squash) 32 days ago

github-actions added ready

Merge branch 'main' into attn_bf16

4bfed7d8

ProExpertProg merged 955b43a5 into main 32 days ago

MatthewBonanni deleted the attn_bf16 branch 32 days ago

Reviewers

tlrmchlsmth

ProExpertProg

gemini-code-assist

pavanimajety

tdoublep

mgoin

WoosukKwon

zhuohan123

youkaichao

alexm-redhat

njhill

LucasWilkinson

bigPYJ1151

robertgshaw2-redhat

yewentao256

Assignees

No one assigned

Labels

bug ready v1 cpu nvidia

Milestone

No milestone

vllm [Bugfix][Attention] Explicitly report support for kv_cache_dtype bfloat16 #32795 Merged

[Bugfix][Attention] Explicitly report support for kv_cache_dtype bfloat16 #32795

vllm
[Bugfix][Attention] Explicitly report support for kv_cache_dtype bfloat16
#32795

Merged