vllm
[Attention] MLA move rotary embedding to cuda-graph region
#17668
Merged
Overview
Commits
4
Changes
View On GitHub

[Attention] MLA move rotary embedding to cuda-graph region #17668

DarkLight1337 merged 4 commits into vllm-project:main from neuralmagic:lwilkinson/mla-move-rot-emb
LucasWilkinson
LucasWilkinson move rot emb
f5196b5b
github-actions
mergify mergify added v1
LucasWilkinson fix v1 torch compile
1f7ba655
LucasWilkinson v0 fix
2eb232a8
LucasWilkinson LucasWilkinson changed the title [WIP][Attention] MLA move rotary embedding to cuda-graph region [Attention] MLA move rotary embedding to cuda-graph region 232 days ago
LucasWilkinson LucasWilkinson marked this pull request as ready for review 232 days ago
LucasWilkinson LucasWilkinson requested a review from WoosukKwon WoosukKwon 232 days ago
LucasWilkinson LucasWilkinson requested a review from robertgshaw2-redhat robertgshaw2-redhat 232 days ago
LucasWilkinson LucasWilkinson requested a review from njhill njhill 232 days ago
LucasWilkinson LucasWilkinson requested a review from ywang96 ywang96 232 days ago
LucasWilkinson LucasWilkinson requested a review from comaniac comaniac 232 days ago
LucasWilkinson LucasWilkinson requested a review from alexm-redhat alexm-redhat 232 days ago
LucasWilkinson fix pre-commit
0b7167ba
mgoin
mgoin approved these changes on 2025-05-08
mgoin mgoin added ready
DarkLight1337 DarkLight1337 merged 5e6f9394 into main 231 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
ready v1
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum