DeepSpeed
Fix llama meta tensor loading in AutoTP and kernel injected inference
#3608
Merged
Overview
Commits
16
Changes
View On GitHub

Fix llama meta tensor loading in AutoTP and kernel injected inference #3608

lekurile merged 16 commits into deepspeedai:master from zeyugao:master
zeyugao
zeyugao zeyugao requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 2 years ago
zeyugao zeyugao requested a review from jeffra jeffra 2 years ago
zeyugao zeyugao requested a review from mrwyattii mrwyattii 2 years ago
zeyugao zeyugao requested a review from awan-10 awan-10 2 years ago
zeyugao zeyugao requested a review from cmikeh2 cmikeh2 2 years ago
zeyugao zeyugao requested a review from arashb arashb 2 years ago
zeyugao Adapt to Llama when using meta tensor to load
d66ae982
zeyugao Fix gated mlp parameter mp
5d1fcf42
zeyugao zeyugao force pushed from b29ef812 to 5d1fcf42 2 years ago
zeyugao
zeyugao zeyugao changed the title Adapte to Llama when using meta tensor to load Fix llama meta tensor loading, model tensor parallelism inference 2 years ago
zeyugao
Yard1
zeyugao
Yard1
lyy1994
zeyugao
lyy1994
lyy1994
davidthomas426
zeyugao
zeyugao
zeyugao Re-enable meta tensor for kernel injection
f8ce148d
zeyugao Merge branch 'master' into master
fe0512fc
zeyugao
thies1006
chhzh123
ganyk
zeyugao
zeyugao
ganyk
zeyugao
zeyugao Merge remote-tracking branch 'origin/master' into pr-master
779bbc3e
zeyugao zeyugao changed the title Fix llama meta tensor loading, model tensor parallelism inference Fix llama meta tensor loading in AutoTP and kernel injected inference 2 years ago
zeyugao Revert mlp_inter_mp for gated mlp as it is fixed
eb695312
xs1997zju
xs1997zju
xs1997zju
ganyk
zeyugao
xs1997zju
zeyugao
xs1997zju
xs1997zju
xs1997zju
zeyugao
xs1997zju
zeyugao Merge remote-tracking branch 'origin/master' into pr-master
02309b50
zeyugao Monkey patch for fixing llama output
3f684cb5
zeyugao zeyugao closed this 2 years ago
zeyugao zeyugao force pushed from eb695312 to 9d79cfd1 2 years ago
zeyugao
zeyugao zeyugao reopened this 2 years ago
zeyugao
lekurile
lekurile Merge branch 'master' of https://github.com/zeyugao/DeepSpeed into ze…
9fbd189a
lekurile t push origin masterMerge branch 'zeyugao-master'
166469cb
lekurile Merge branch 'master' of https://github.com/microsoft/DeepSpeed
e35f460b
lekurile Fix formatting
f2f92fe9
lekurile Merge branch 'master' into master
07ac3c7d
lekurile Merge branch 'master' into master
a98e6463
lekurile lekurile enabled auto-merge 2 years ago
lekurile Add comment
f51feaee
lekurile Merge branch 'master' of https://github.com/zeyugao/DeepSpeed
0a5dd861
lekurile
lekurile approved these changes on 2023-09-20
lekurile lekurile merged 4fc2c8e7 into master 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum