DeepSpeed
Fix assert on Lamb optimizers with BF16
#4451
Open
Overview
Commits
18
Changes
View On GitHub

Fix assert on Lamb optimizers with BF16 #4451

loadams wants to merge 18 commits into master from loadams/lamb-bf16
loadams
loadams Add bf16 check
548852cc
loadams Format fixes
2f10df57
loadams loadams requested a review from jeffra jeffra 2 years ago
loadams loadams requested a review from tjruwase tjruwase 2 years ago
loadams
loadams commented on 2023-10-04
tjruwase
loadams Merge branch 'master' into loadams/lamb-bf16
023aa621
loadams Merge branch 'master' into loadams/lamb-bf16
35aabdc3
loadams loadams requested a review from mrwyattii mrwyattii 1 year ago
loadams Fix issue before
9eb6af64
loadams fp16_enabled() not float16_enabled()
1ef677b0
tjruwase Merge branch 'master' into loadams/lamb-bf16
1d87c248
Liangliang-Ma
loadams
loadams Merge branch 'master' into loadams/lamb-bf16
45577e51
loadams
loadams Merge branch 'master' into loadams/lamb-bf16
7c71aa84
loadams Merge branch 'master' into loadams/lamb-bf16
0b330c1e
loadams Merge branch 'master' into loadams/lamb-bf16
117b4df5
loadams Merge branch 'master' into loadams/lamb-bf16
bb99d040
Liangliang-Ma
loadams Merge branch 'master' into loadams/lamb-bf16
e468fee8
loadams
loadams Merge branch 'master' into loadams/lamb-bf16
ccda5fe9
loadams Merge branch 'master' into loadams/lamb-bf16
ecfba271
loadams loadams requested a review from tohtana tohtana 1 year ago
loadams Merge branch 'master' into loadams/lamb-bf16
8033e99b
loadams Merge branch 'master' into loadams/lamb-bf16
9addfd1d
loadams loadams assigned loadams loadams 330 days ago
loadams Merge branch 'master' into loadams/lamb-bf16
33024a53

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum