add adamW and deepspeed-adamw mode - SemanticDiff

Commit

5 years ago

add adamW and deepspeed-adamw mode

References

#484 - Add CPUAdam optimizer for zero-offload in deepspeed engine

Author

Reza Yazdani

Parents

Loading