vllm
mla: don't update kv cache on dummy forwards
#36282

Merged

mla: don't update kv cache on dummy forwards #36282

MatthewBonanni merged 1 commit into vllm-project:main from itayalroy:fix_mla_kvcache_update

mla: don't update kv cache on dummy forwards

1040fa48

itayalroy requested a review from

LucasWilkinson 108 days ago

itayalroy requested a review from

MatthewBonanni 108 days ago

MatthewBonanni approved these changes on 2026-03-06

gemini-code-assist commented on 2026-03-06

MatthewBonanni enabled auto-merge (squash) 108 days ago

tlrmchlsmth added ready

wangshangsam added nvidia

wangshangsam assigned

itayalroy 108 days ago

MatthewBonanni merged 24a03915 into main 108 days ago

Reviewers

MatthewBonanni

gemini-code-assist

LucasWilkinson

Assignees

itayalroy

Labels

ready nvidia

Milestone

No milestone