onnxruntime
Train BERT Using BFloat16 on A100
#6090
Merged
Overview
Commits
17
Changes
View On GitHub

Train BERT Using BFloat16 on A100 #6090

Lafi7e merged 17 commits into master from weicwang/bf16bert
Lafi7e
Lafi7e traing bert using bf16
2dd8325b
Lafi7e Adam support bf16
b588c3ae
Lafi7e Merge branch 'master' into weicwang/bf16bert
ed40a969
Lafi7e bugfix
8f60605e
Lafi7e add fusedmatmul support
1d9ed6a1
Lafi7e Merge branch 'master' into weicwang/bf16bert
4f3339b0
Lafi7e fix after merge from master.
02214cfb
Lafi7e bugfix
ac4e5502
Lafi7e Merge branch 'master' into weicwang/bf16bert
75901298
Lafi7e bugfix after merge from master
6c2accb7
Lafi7e Merge branch 'master' into weicwang/bf16bert
de8e4ec2
Lafi7e Lafi7e added training
Lafi7e Lafi7e requested a review from SherlockNoMad SherlockNoMad 5 years ago
Lafi7e Lafi7e requested a review from weixingzhang weixingzhang 5 years ago
Lafi7e Lafi7e requested a review 5 years ago
weixingzhang
yuslepukhin
yuslepukhin
yuslepukhin commented on 2020-12-09
yuslepukhin
yuslepukhin commented on 2020-12-09
yuslepukhin
yuslepukhin commented on 2020-12-09
yuslepukhin
yuslepukhin commented on 2020-12-09
Lafi7e fast reduction for bf16.
7a958336
Lafi7e Merge branch 'master' into weicwang/bf16bert
e654823b
Lafi7e resolve comments
7b0808e6
Lafi7e fix win build
15172bb1
Lafi7e bugfix
f7a4459a
Lafi7e change header file.
c63408b6
weixingzhang
weixingzhang approved these changes on 2021-01-14
Lafi7e Lafi7e merged 4df356d1 into master 5 years ago
Lafi7e Lafi7e deleted the weicwang/bf16bert branch 5 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
training
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum