transformers
deepspeed resume from ckpt fixes and adding support for deepspeed optimizer and HF scheduler
#25863
Merged
Merged
deepspeed resume from ckpt fixes and adding support for deepspeed optimizer and HF scheduler #25863
pacman100
merged
13 commits into
main
from
smangrul/ds-fixes-and-tests
Add support for deepspeed optimizer and HF scheduler
397dcad3
fix bug
c19567ab
fix the import
2bcc4e62
pacman100
changed the title
Merge branch 'main' into smangrul/ds-fixes-and-tests
c4d05308
Merge branch 'main' into smangrul/ds-fixes-and-tests
51d720dc
fix issue with deepspeed scheduler saving for hf optim + hf scheduler…
224892a2
fix loading of hf scheduler when loading deepspeed checkpoint
577150fa
fix import of `DeepSpeedSchedulerWrapper`
2cb4088a
add tests
d77abfa3
add the comment and skip the failing tests
2d509d15
Merge branch 'main' into smangrul/ds-fixes-and-tests
83971a12
Merge branch 'main' into smangrul/ds-fixes-and-tests
44892b71
address comment
76ae0560
muellerzr
approved these changes
on 2023-09-05
Login to write a write a comment.
Login via GitHub