Add ZeRO-Offload model tests - SemanticDiff

Commit

5 years ago

Add ZeRO-Offload model tests Restrict optimizer update+copy to DeepSpeedCPUAdam

References

#374 - ZeRO-Offload passing model tests

Author

tjruwase

tjruwase

Parents

Loading