DeepSpeed
fix lm head overriden issue, move it from checkpoint in-loop loading …
#4206

Merged

fix lm head overriden issue, move it from checkpoint in-loop loading … #4206

mrwyattii merged 2 commits into deepspeedai:master from sywangyi:checkpt_lm_head

sywangyi requested a review from

RezaYazdaniAminabadi 2 years ago

sywangyi requested a review from

jeffra 2 years ago

sywangyi requested a review from

mrwyattii 2 years ago

sywangyi requested a review from

awan-10 2 years ago

sywangyi requested a review from

cmikeh2 2 years ago

sywangyi requested a review from

arashb 2 years ago

awan-10 assigned

RezaYazdaniAminabadi 2 years ago

tjruwase commented on 2023-09-27

fix lm head overriden issue, move it from checkpoint in-loop loading …

6ee6f0fa

sywangyi force pushed from 58c8231d to 6ee6f0fa 1 year ago

tjruwase approved these changes on 2023-09-28

Merge branch 'master' into checkpt_lm_head

0d3d79c4

mrwyattii merged d72edb3b into master 1 year ago

Reviewers

tjruwase

jeffra

mrwyattii

awan-10

cmikeh2

arashb

Assignees

Labels

None yet

Milestone

No milestone