vllm
[Hardware] [Intel] Enable Multiprocessing and tensor parallel in CPU backend and update documentation
#6125
Merged
Overview
Commits
36
Changes
View On GitHub

[Hardware] [Intel] Enable Multiprocessing and tensor parallel in CPU backend and update documentation #6125

WoosukKwon merged 36 commits into vllm-project:main from bigPYJ1151:mp_based
bigPYJ1151
bigPYJ1151 bigPYJ1151 marked this pull request as draft 1 year ago
bigPYJ1151 bigPYJ1151 marked this pull request as ready for review 1 year ago
bigPYJ1151 bigPYJ1151 changed the title [CPU] Enable Multiprocessing in CPU backend and documentation update [Hardware] [Intel] Enable Multiprocessing in CPU backend and documentation update 1 year ago
bigPYJ1151 bigPYJ1151 changed the title [Hardware] [Intel] Enable Multiprocessing in CPU backend and documentation update [Hardware] [Intel] Enable Multiprocessing in CPU backend and update documentation 1 year ago
WoosukKwon WoosukKwon added x86 CPU
bigPYJ1151 bigPYJ1151 force pushed to c2506e03 1 year ago
bigPYJ1151 bigPYJ1151 force pushed to b45597d0 1 year ago
bigPYJ1151 bigPYJ1151 changed the title [Hardware] [Intel] Enable Multiprocessing in CPU backend and update documentation [Hardware] [Intel] Enable Multiprocessing and tensor parallel in CPU backend and update documentation 1 year ago
bigPYJ1151 bigPYJ1151 force pushed 1 year ago
bigPYJ1151
github-actions github-actions added ready
bigPYJ1151
lhtin
bigPYJ1151
WoosukKwon
bigPYJ1151
WoosukKwon
WoosukKwon WoosukKwon assigned WoosukKwon WoosukKwon 1 year ago
WoosukKwon WoosukKwon requested a review from WoosukKwon WoosukKwon 1 year ago
WoosukKwon
WoosukKwon commented on 2024-07-22
bigPYJ1151
zhouyuan
bigPYJ1151 bigPYJ1151 force pushed 1 year ago
bigPYJ1151 Adapt MP to cpu_executor
be05b47d
bigPYJ1151 Add CI
be11ea55
bigPYJ1151 update
3b56f133
bigPYJ1151 update
e1fd2677
bigPYJ1151 update doc
c0ab0199
bigPYJ1151 format
3d653f6e
bigPYJ1151 update
84d80291
bigPYJ1151 Fix
c7fee29e
bigPYJ1151 trigger
0d85c416
bigPYJ1151 trigger
991e8b39
bigPYJ1151 trigger
1845d955
bigPYJ1151 fix
766705e3
bigPYJ1151 Fix
fae95345
bigPYJ1151 fix conflict
6cfbedf4
bigPYJ1151 disable KMP setting dumping
51d0eda2
bigPYJ1151 trigger
ddcae0d2
bigPYJ1151 trigger
331b4f5d
bigPYJ1151 trigger
8af42c04
bigPYJ1151 trigger
f61b9a8c
bigPYJ1151 Update
c3d028e1
bigPYJ1151 Add shm op
6be36d67
bigPYJ1151 Revert "Add shm op"
f1fbb24f
bigPYJ1151 Add IPEX Allreduce
4a13516a
bigPYJ1151 remove prune
ecd2cac4
bigPYJ1151 update IPEX
6fb8f909
bigPYJ1151 update doc
43766b5e
bigPYJ1151 retrigger
eafb75f6
bigPYJ1151 fix comments
cfbeae51
bigPYJ1151 Update csrc/cpu/utils.cpp
3f7384fb
bigPYJ1151 fix doc
cc4b3305
bigPYJ1151 retrigger
32684975
bigPYJ1151 retrigger
63e085c9
bigPYJ1151 remove assert
7f48a4f6
bigPYJ1151 bigPYJ1151 force pushed to 7f48a4f6 1 year ago
bigPYJ1151 add time out
c87f0aba
bigPYJ1151 bigPYJ1151 force pushed to c87f0aba 1 year ago
WoosukKwon
bigPYJ1151 Revert "add time out"
a5a13cdc
bigPYJ1151 using random dataset
aceded90
bigPYJ1151
WoosukKwon
WoosukKwon approved these changes on 2024-07-26
WoosukKwon WoosukKwon merged 3bbb4936 into main 1 year ago
DamonFool
DamonFool
DamonFool commented on 2024-07-31

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
Labels
ready
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum