DeepSpeed
engine.py - save_checkpoint: only rank-0 should create the save dir
#4536
Merged

engine.py - save_checkpoint: only rank-0 should create the save dir #4536

nelyahu
engine.py - save_checkpoint: only rank-0 should create the save dir
b49889a8
nelyahu nelyahu requested a review from jeffra jeffra 2 years ago
nelyahu nelyahu requested a review from tjruwase tjruwase 2 years ago
tjruwase
tjruwase commented on 2023-10-18
save_checkpoint: In case of local storage only local rank 0 should mkdir
f0f95ede
tjruwase
tjruwase approved these changes on 2023-10-23
tjruwase Merge branch 'master' into onlyRank0CreateCPfolder
2a2b11e5
tjruwase tjruwase merged b891ec2a into master 2 years ago
nelyahu nelyahu deleted the onlyRank0CreateCPfolder branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone