onnxruntime
4df356d1 - Train BERT Using BFloat16 on A100 (#6090)

Commit
5 years ago
Train BERT Using BFloat16 on A100 (#6090) * traing bert using bf16 * Adam support bf16 * bugfix * add fusedmatmul support * fix after merge from master. * bugfix * bugfix after merge from master * fast reduction for bf16. * resolve comments * fix win build * bugfix * change header file. Co-authored-by: Vincent Wang <weicwang@microsoft.com>
Author
Parents
Loading