vllm
Fix kv_cache_dtype handling for out-of-tree HPU plugin
#21302

Merged

Fix kv_cache_dtype handling for out-of-tree HPU plugin #21302

vllm-bot merged 7 commits into vllm-project:main from HabanaAI:private/kzawora/kv_cache_dtype_fix

gemini-code-assist commented on 2025-07-21

kzawora-intel force pushed to d09dd8a5 168 days ago

DarkLight1337 commented on 2025-07-21

mergify added rocm

mergify added tpu

xuechendi approved these changes on 2025-07-21

DarkLight1337 commented on 2025-07-21

DarkLight1337 approved these changes on 2025-07-21

DarkLight1337 added this to the v0.10.0 milestone 168 days ago

DarkLight1337 enabled auto-merge (squash) 168 days ago

DarkLight1337 added ready

mgoin commented on 2025-07-21

disabled auto-merge 168 days ago
Head branch was pushed to by a user without write access

xuechendi force pushed from 19f684ef 168 days ago

Fix kv_cache_dtype handling for out-of-tree HPU plugin

25094688

thank u gemini

71ae2dc6

add is_kv_cache_dtype_supported method to platform interface

81bac7c1

remove unneeded if

a80bea91

address CR

d87c1d04

update base class for is_kv_cache_dtype_supported nto return always F…

8967b58c

update cuda is_kv_cache_dtype_supported to exactly follow original

ca115a2f

xuechendi force pushed to ca115a2f 168 days ago

vllm-bot merged c17231e8 into main 167 days ago

Reviewers

DarkLight1337

xuechendi

mgoin

gemini-code-assist

Assignees

No one assigned

Labels

rocm tpu ready

Milestone

v0.10.0