PR #3600 fix opt-350m shard loading issue in AutoTP

fix opt-350m shard loading issue in AutoTP #3600

jeffra merged 7 commits into deepspeedai:master from sywangyi:fix-opt-350m

fix opt-350m shard loading issue in AutoTP

98c4a42c

sywangyi requested a review from

RezaYazdaniAminabadi 3 years ago

sywangyi requested a review from

jeffra 3 years ago

sywangyi requested a review from

mrwyattii 3 years ago

sywangyi requested a review from

awan-10 3 years ago

sywangyi requested a review from

cmikeh2 3 years ago

sywangyi requested a review from

arashb 3 years ago

sywangyi requested a review from

tjruwase 3 years ago

Merge branch 'master' into fix-opt-350m

e6061116

Merge branch 'master' into fix-opt-350m

b49145b7

Merge branch 'master' into fix-opt-350m

b9860e73

Merge branch 'master' into fix-opt-350m

3234079f

Merge branch 'master' into fix-opt-350m

aa6aefdb

molly-smith requested a review from

molly-smith 2 years ago

RezaYazdaniAminabadi approved these changes on 2023-07-27

molly-smith approved these changes on 2023-07-27

Merge branch 'master' into fix-opt-350m

82d8a967

jeffra enabled auto-merge 2 years ago

jeffra merged 76953a37 into master 2 years ago

Reviewers

molly-smith

RezaYazdaniAminabadi

jeffra

mrwyattii

awan-10

cmikeh2

arashb

tjruwase

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed fix opt-350m shard loading issue in AutoTP #3600 Merged

fix opt-350m shard loading issue in AutoTP #3600

DeepSpeed
fix opt-350m shard loading issue in AutoTP
#3600

Merged