DeepSpeed
3293cf72 - [ZeRO] Default disable elastic ckpt in stage 1+2 and reduce CPU memory overhead during ckpt load (#1525)

Commit

3 years ago

[ZeRO] Default disable elastic ckpt in stage 1+2 and reduce CPU memory overhead during ckpt load (#1525) Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>

References

#1525 - [ZeRO] Default disable elastic ckpt in stage 1+2 and reduce CPU memory overhead during ckpt load

Author

jeffra

Parents

e4cf40d6

DeepSpeed 3293cf72 - [ZeRO] Default disable elastic ckpt in stage 1+2 and reduce CPU memory overhead during ckpt load (#1525)

DeepSpeed
3293cf72 - [ZeRO] Default disable elastic ckpt in stage 1+2 and reduce CPU memory overhead during ckpt load (#1525)