vllm
[Kernel][LoRA]Punica prefill kernels fusion
#11234
Merged
Overview
Commits
70
Changes
View On GitHub

[Kernel][LoRA]Punica prefill kernels fusion #11234

DarkLight1337 merged 70 commits into vllm-project:main from jeejeelee:punica-kernel-fusion
jeejeelee
jeejeelee Init
ec3590d9
jeejeelee Sync main
9474fb01
jeejeelee Fix bug
8c2ac4ca
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
2897d053
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
35aebea9
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
628a5670
jeejeelee Back up
d04121ca
jeejeelee shrink_sgmv Done
a306f424
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
f6bccc78
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
e5cb72e2
jeejeelee Optimize ptr compute
b6013db4
jeejeelee Merge commit 'b6013db4' into punica-kernel-fusion
7f088ec5
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
32c52792
jeejeelee Increase the tile size
8d3742ba
jeejeelee Clean up triton interface
9564b33d
jeejeelee Sync main
3eb3ac3e
jeejeelee Backup
40124669
jeejeelee Optimize one sclice kernel
18bbadf1
jeejeelee jeejeelee marked this pull request as draft 1 year ago
github-actions
jeejeelee Delete unused code
43aae702
jeejeelee Refactor expand
482de154
jeejeelee format
259d382f
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
00f19046
jeejeelee Optimize logic
a0197e3e
jeejeelee Add comments
38ba4f1c
jeejeelee Fix bug
3c372265
jeejeelee Fix expand bug
45180c13
jeejeelee Backup
2e52d2c4
jeejeelee revert expand tile size
2146141b
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
d724891b
jeejeelee Clean up code
9719617c
mergify mergify added ci/build
jeejeelee Optimize expand tile size
5d2c557a
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
958500d5
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
5c88ec4d
Abatom improve expand (#3)
3460308f
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
24e893c9
Abatom Lora expand (#4)
c9747c63
Abatom Lora expand (#5)
f3ecfc64
jeejeelee Fix K size
5859da77
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
b3ea6fc0
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
eb010892
Abatom revert (#6)
ebc9519b
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
a4f46b6e
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
2cdf4593
jeejeelee Add unit test
ba2c4442
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
394886d9
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
36fbeac2
jeejeelee Optimize unit test
0f7897b6
jeejeelee Optimize unit test
3edb696b
jeejeelee Fix comment
49c6c21d
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
bf3b9ca9
jeejeelee jeejeelee requested a review from Isotr0py Isotr0py 1 year ago
jeejeelee jeejeelee requested a review from DarkLight1337 DarkLight1337 1 year ago
jeejeelee jeejeelee marked this pull request as ready for review 1 year ago
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
fe24a41d
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
9d89f47f
DarkLight1337
DarkLight1337 commented on 2024-12-27
jeejeelee jeejeelee requested a review from mgoin mgoin 1 year ago
mgoin
mgoin commented on 2024-12-27
Isotr0py
Isotr0py commented on 2024-12-27
varun-sundar-rabindranath
varun-sundar-rabindranath commented on 2024-12-27
varun-sundar-rabindranath
varun-sundar-rabindranath commented on 2024-12-27
varun-sundar-rabindranath
jeejeelee Optimize code
489eca1e
jeejeelee
jeejeelee Add lock for unit test
04ae0dd7
varun-sundar-rabindranath
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
fa489f2f
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
ea19a7d0
jeejeelee Optimize arg
65d0f2f2
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
797ae774
varun-sundar-rabindranath
varun-sundar-rabindranath approved these changes on 2024-12-30
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
2b9f928e
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
09fb9a93
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
f4464548
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
767b233e
jeejeelee Fix expand bug
421382e0
mgoin
mgoin approved these changes on 2025-01-03
jeejeelee jeejeelee requested a review from DarkLight1337 DarkLight1337 1 year ago
jeejeelee jeejeelee requested a review from Isotr0py Isotr0py 1 year ago
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
90a91178
Isotr0py
Isotr0py approved these changes on 2025-01-03
jeejeelee jeejeelee added ready
jeejeelee Reduce memory
2c792952
jeejeelee jeejeelee removed ready
jeejeelee jeejeelee removed ci/build
jeejeelee Modify minicpmv test
7e8d3bd3
jeejeelee jeejeelee force pushed to 7e8d3bd3 1 year ago
mergify mergify added ci/build
jeejeelee
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
02b1d805
jeejeelee jeejeelee added ready
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
bd8cc450
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
7ffd15ec
jeejeelee Merge branch 'vllm-project:main' into punica-kernel-fusion
c1c5b4b7
DarkLight1337 DarkLight1337 enabled auto-merge (squash) 1 year ago
DarkLight1337 DarkLight1337 merged b2785579 into main 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
ready ci/build
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum