PLD release (#513)
* Progressive layer dropping docs (#499)
* test
* Adding tutorial and news page for pld
* updating the tutorial and posts of PLD
* update the finetune tutorial
* Update PLD tutorial (#512)
* Update installation instructions
* Format fix
* ZeRO tutorial
* Format fixes
* ZeRO-Offload
* ZeRO and ZeRO-Offload tutorials
* Update navigation page
* Format fixes
* Add yuxhe feedback
* Fix blog post link
* Fix OneBit-Adam link
Tweak scheduler example
* Fix date link
* Add DeepSpeed_Adam
* Add PLD tutorial to navigation
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
* updating the pld docs
* DeepSpeed implementation of PLD (#508)
* DeepSpeed implementation of PLD
* Format fixes
* Formatting fixes
* Fix broken url
* Address PR feedback
* Bump DSE
Co-authored-by: Minjia Zhang <33713995+minjiaz@users.noreply.github.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Co-authored-by: Minjia Zhang <minjiaz@microsoft.com>
