DeepSpeed
a76572dc - Adding static loss scaling for ZeRO. (#166)

Commit

5 years ago

Adding static loss scaling for ZeRO. (#166)

References

#166 - Adding static loss scaling for ZeRO.

Author

Shaden Smith

Parents

Loading