DeepSpeed
dc801066 - udpate fp32 master params of bf16 optimizer after allreduce

Commit

2 years ago

udpate fp32 master params of bf16 optimizer after allreduce

Author

Masahiro Tanaka

Parents

Loading