vllm
[Kernel] FlashMLA integration
#13747
Merged
Overview
Commits
26
Changes
View On GitHub

[Kernel] FlashMLA integration #13747

youkaichao merged 26 commits into vllm-project:main from LucasWilkinson:lwilkinson/flashmla-integration
LucasWilkinson
github-actions
mergify mergify added ci/build
LucasWilkinson LucasWilkinson force pushed to 3ae4a6ef 298 days ago
tlrmchlsmth
tlrmchlsmth commented on 2025-02-25
tlrmchlsmth
tlrmchlsmth commented on 2025-02-25
tlrmchlsmth
tlrmchlsmth commented on 2025-02-25
youkaichao
youkaichao commented on 2025-02-25
LucasWilkinson LucasWilkinson marked this pull request as ready for review 297 days ago
LucasWilkinson LucasWilkinson requested a review from WoosukKwon WoosukKwon 297 days ago
LucasWilkinson
Stonesjtu
youkaichao
leonzy
mgoin
mgoin commented on 2025-02-25
LucasWilkinson
LucasWilkinson LucasWilkinson added ready
mergify
mergify mergify added needs-rebase
LucasWilkinson torch library bindings, unit tests running
c5faa922
LucasWilkinson comments
a1832e90
LucasWilkinson working in eager mode
bef305b3
LucasWilkinson format
c74a4f04
LucasWilkinson cuda-graphs still broken but closer i think
1cb71c7a
LucasWilkinson better comments
205f2bc5
LucasWilkinson remove extra files
00a1f7a3
LucasWilkinson add attribution
905be3bf
LucasWilkinson fix cuda graphs
728e0b64
LucasWilkinson cleaner build fallbacks
6681e43a
LucasWilkinson ok cuda-graphs actually fixed now I think
4a755b99
LucasWilkinson format
649a7bf1
LucasWilkinson clean up
20315610
LucasWilkinson review comment
1722bb06
LucasWilkinson fix mypy
8e64f74d
LucasWilkinson review comments
b0577928
LucasWilkinson cleanup
87499c34
LucasWilkinson fix bad logic
c47e8144
LucasWilkinson review comments
cf3e5bd5
LucasWilkinson update to latest flashMLA which supports fp16
d474a4b7
LucasWilkinson update to use fork
337f3ee5
LucasWilkinson remove unnessary include
48207c9e
LucasWilkinson add fp16 source
c215c6a3
LucasWilkinson missing symbol
02a46a3d
LucasWilkinson LucasWilkinson force pushed from 2fa62a9d to 02a46a3d 297 days ago
mergify mergify removed needs-rebase
billishyahao
LucasWilkinson
LucasWilkinson improve logging, skip flashmla tests when not supported
b0552982
fan-niu
billishyahao
billishyahao
zeroorhero
LucasWilkinson fix pytest errors
ca7fa2d3
LucasWilkinson
mgoin
mgoin approved these changes on 2025-02-26
mgoin mgoin added force-merge
tlrmchlsmth
tlrmchlsmth approved these changes on 2025-02-26
zeroorhero
youkaichao youkaichao merged f9590390 into main 296 days ago
simon-mo
ZhongYingMatrix
billishyahao
tlrmchlsmth

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
ready ci/build force-merge
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum