DeepSpeed
99951caa - Fix sorting of shard optimizer states files for universal checkpoint (#5395)

Commit
1 year ago
Fix sorting of shard optimizer states files for universal checkpoint (#5395) This PR resolves the issue reported in #5283. To resolve the issue, we sort files of sharded optimizer states based on DP indices. --------- Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
Author
Parents
Loading