DeepSpeed
Support InternLM
#4137
Merged
Overview
Commits
17
Changes
View On GitHub

Support InternLM #4137

lekurile merged 17 commits into deepspeedai:master from wangruohui:support_internlm_0.10.0
wangruohui
wangruohui wangruohui requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 2 years ago
wangruohui wangruohui requested a review from jeffra jeffra 2 years ago
wangruohui wangruohui requested a review from mrwyattii mrwyattii 2 years ago
wangruohui wangruohui requested a review from awan-10 awan-10 2 years ago
wangruohui wangruohui requested a review from cmikeh2 cmikeh2 2 years ago
wangruohui wangruohui requested a review from arashb arashb 2 years ago
wangruohui
wangruohui correct inference with some debug codes.
b593a3d6
wangruohui remove prints
baf02586
wangruohui update transformer import set_qkv and format
a87c97d4
wangruohui support some lora abstract method
8449044b
wangruohui fix attn_ob
5c80d833
wangruohui some debug
ee1ccd3f
wangruohui leave orig layer set by user
bdf8a90f
wangruohui wangruohui force pushed from 954dac5e to bdf8a90f 2 years ago
wangruohui remove debugs
76f00b6b
wangruohui wangruohui closed this 2 years ago
wangruohui wangruohui deleted the support_internlm_0.10.0 branch 2 years ago
wangruohui wangruohui restored the head branch 2 years ago
wangruohui wangruohui reopened this 2 years ago
molly-smith molly-smith requested a review from molly-smith molly-smith 2 years ago
molly-smith molly-smith requested a review from lekurile lekurile 2 years ago
molly-smith molly-smith assigned molly-smith molly-smith 2 years ago
lekurile lekurile assigned lekurile lekurile 2 years ago
lekurile
wangruohui
lekurile Merge branch 'master' into support_internlm_0.10.0
b3bd0c65
lekurile
lekurile Merge branch 'master' into support_internlm_0.10.0
835a493d
wangruohui
lekurile
wangruohui move attn ob to mlp module
1ac20f06
wangruohui
lekurile Merge branch 'master' into support_internlm_0.10.0
d1dac2b1
lekurile
lekurile requested changes on 2023-09-12
wangruohui move import transformer
bf49fe99
wangruohui init orig class only once
8796eef1
molly-smith molly-smith unassigned molly-smith molly-smith 2 years ago
lekurile
lekurile requested changes on 2023-09-14
wangruohui remove copyright
cbdc39a5
wangruohui Merge branch 'master' into support_internlm_0.10.0
1e9068aa
lekurile Merge branch 'master' into support_internlm_0.10.0
d7a7a9aa
lekurile
lekurile approved these changes on 2023-09-18
lekurile lekurile enabled auto-merge 2 years ago
lekurile lekurile merged 367d6f9c into master 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum