DeepSpeed
dc801066 - udpate fp32 master params of bf16 optimizer after allreduce

Commit

1 year ago

udpate fp32 master params of bf16 optimizer after allreduce

Author

Masahiro Tanaka

Parents

Loading