DeepSpeed
[MiCS] [Bugfix] set self.save_non_zero_checkpoint=True only for first partition group
#3787
Merged
Overview
Commits
4
Changes
View On GitHub

[MiCS] [Bugfix] set self.save_non_zero_checkpoint=True only for first partition group #3787

tjruwase merged 4 commits into deepspeedai:master from dmlc:mics-fix-ckpt-saving
zarzen
save_non_zero_checkpoint on first partition group
16f31683
zarzen zarzen requested a review from jeffra jeffra 2 years ago
zarzen zarzen requested a review from tjruwase tjruwase 2 years ago
zarzen zarzen requested a review from mrwyattii mrwyattii 2 years ago
jeffra jeffra force-pushed the master branch from f6e2e38b to bafaf3c0 2 years ago
zarzen Merge branch 'master' into mics-fix-ckpt-saving
6a4c45db
zarzen Merge branch 'microsoft:master' into mics-fix-ckpt-saving
d6c5f7e3
zarzen Merge branch 'master' into mics-fix-ckpt-saving
761a9ca8
tjruwase
tjruwase approved these changes on 2023-07-28
tjruwase tjruwase merged 8a63754b into master 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum