vllm
move checks out of `unified_kv_cache_update` custom op
#33943
Merged

move checks out of `unified_kv_cache_update` custom op #33943

Rohan138
Rohan138 move k v and kvcache sharing checks out of custom op
d4f05e85
Rohan138 drop check in selfattention, add check in cross and whisper
aab9a411
Rohan138 Rohan138 requested a review from tjtanaa tjtanaa 114 days ago
Rohan138 Rohan138 requested a review from gshtras gshtras 114 days ago
Rohan138 Rohan138 requested a review from tdoublep tdoublep 114 days ago
Rohan138 Rohan138 requested a review from LucasWilkinson LucasWilkinson 114 days ago
mergify mergify added rocm
mergify mergify added v1
Rohan138 drop check in selfattention, add check in cross and whisper
3237a8fa
gemini-code-assist
gemini-code-assist commented on 2026-02-05
Rohan138 drop check in selfattention, add check in cross and whisper
ef7c95dc
Rohan138 revert to original check for both self and cross attention
fe54c4b6
Rohan138 Rohan138 requested a review from ProExpertProg ProExpertProg 114 days ago
ProExpertProg
ProExpertProg approved these changes on 2026-02-06
ProExpertProg ProExpertProg added ready-run-all-tests
Rohan138 add missing init for kv_cache_dummy_deop
849d6f9a
ProExpertProg ProExpertProg enabled auto-merge (squash) 113 days ago
github-actions github-actions added ready
disabled auto-merge 113 days ago
Manually disabled by user
Rohan138
ProExpertProg ProExpertProg enabled auto-merge (squash) 113 days ago
Rohan138 Merge branch 'main' into rope_kvcache_refactor
a932a169
vllm-bot vllm-bot merged de3869bb into main 112 days ago
Rohan138 Rohan138 deleted the rope_kvcache_refactor branch 95 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone