vllm
[Kernel] Enable Hybrid Model Support in Triton Unified Attention Kernel
#21197
Merged
Overview
Commits
30
Changes
View On GitHub

[Kernel] Enable Hybrid Model Support in Triton Unified Attention Kernel #21197

tdoublep merged 30 commits into vllm-project:main from jvlunteren:jvl-hybrid-support
jvlunteren
jvlunteren modify shape of kv cache
c3f8dd47
jvlunteren removed prefill support from split-kv attention
7d52de7e
jvlunteren added reorder_batch method
41a12543
jvlunteren added tiling to support large non-power-of-2 block sizes
6109a140
jvlunteren formatting
343ed93c
jvlunteren updated parameters
a96e2295
jvlunteren jvlunteren requested a review from WoosukKwon WoosukKwon 1 year ago
jvlunteren jvlunteren requested a review from robertgshaw2-redhat robertgshaw2-redhat 1 year ago
jvlunteren jvlunteren requested a review from njhill njhill 1 year ago
jvlunteren jvlunteren requested a review from ywang96 ywang96 1 year ago
jvlunteren jvlunteren requested a review from comaniac comaniac 1 year ago
jvlunteren jvlunteren requested a review from alexm-redhat alexm-redhat 1 year ago
github-actions
mergify mergify added v1
gemini-code-assist
gemini-code-assist commented on 2025-07-18
mergify
mergify mergify added needs-rebase
jvlunteren resolved conflicts
ffa29db3
mergify mergify removed needs-rebase
jvlunteren removed unneeded files
6a375ee4
jvlunteren Merge branch 'vllm-project:main' into jvl-hybrid-support
39e352d5
jvlunteren add prefill support back to split-kv kernel
c4f7d677
jvlunteren
mergify
mergify mergify added needs-rebase
jvlunteren removed changes to triton_attn.py
b4fd773d
mergify mergify removed needs-rebase
jvlunteren Merge branch 'vllm-project:main' into jvl-hybrid-support
40218f46
jvlunteren restored changes to triton_attn.py
832ccb8d
jvlunteren formatting
d893bcb6
jvlunteren Merge branch 'main' into jvl-hybrid-support
02b04645
jvlunteren formatting
9b63155d
jvlunteren Merge branch 'main' into jvl-hybrid-support
d3979e9c
jvlunteren Merge branch 'main' into jvl-hybrid-support
771f5246
jvlunteren Merge branch 'main' into jvl-hybrid-support
ec62011b
jvlunteren temporarily revert changes to enable simpler merge with latest main
39ed6b6e
jvlunteren Merge branch 'vllm-project:main' into jvl-hybrid-support
eead28ea
jvlunteren
jvlunteren Merge branch 'vllm-project:main' into jvl-hybrid-support
2b415b65
jvlunteren restore changes to triton_unified_attention.py
4254fad7
jvlunteren jvlunteren requested a review from tdoublep tdoublep 319 days ago
jvlunteren Merge branch 'main' into jvl-hybrid-support
db615014
jvlunteren Merge branch 'main' into jvl-hybrid-support
3605c65b
tdoublep
tdoublep commented on 2025-09-17
jvlunteren replaced block size check by tile size check
8a846bcf
jvlunteren jvlunteren requested a review from mgoin mgoin 318 days ago
jvlunteren jvlunteren requested a review from tlrmchlsmth tlrmchlsmth 318 days ago
jvlunteren jvlunteren requested a review from yewentao256 yewentao256 318 days ago
jvlunteren Merge branch 'main' into jvl-hybrid-support
f41f90e2
jvlunteren
jvlunteren assign default tile sizes for prefill and decode, remove check
3dedd209
jvlunteren
jvlunteren Merge branch 'main' into jvl-hybrid-support
ee82dd53
tdoublep
tdoublep approved these changes on 2025-09-18
tdoublep tdoublep enabled auto-merge (squash) 317 days ago
github-actions github-actions added ready
jvlunteren Merge branch 'main' into jvl-hybrid-support
8da5f743
tdoublep tdoublep merged 01a583fe into main 317 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
ready v1
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum