DeepSpeed
Syncing FusedAdam with new Apex features
#3434
Merged
Overview
Commits
15
Changes
View On GitHub

Syncing FusedAdam with new Apex features #3434

jomayeri merged 15 commits into master from jomayeri/issue-3006
jomayeri
jomayeri Updating fused adam with new Apex bf16 support.
d123fa00
jomayeri Removing capturable and master weight configs.
28b153da
jomayeri jomayeri requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 2 years ago
jomayeri jomayeri requested a review from jeffra jeffra 2 years ago
jomayeri jomayeri requested a review from mrwyattii mrwyattii 2 years ago
jomayeri jomayeri requested a review from awan-10 awan-10 2 years ago
jomayeri jomayeri requested a review from cmikeh2 cmikeh2 2 years ago
jomayeri jomayeri requested a review from arashb arashb 2 years ago
jomayeri Merge branch 'master' into jomayeri/issue-3006
caa30bb1
jomayeri Merge branch 'master' into jomayeri/issue-3006
da9f0c9b
jomayeri Merge branch 'master' into jomayeri/issue-3006
53e601ff
jomayeri Merge branch 'master' into jomayeri/issue-3006
7798c163
tjruwase
tjruwase commented on 2023-05-09
tjruwase
tjruwase commented on 2023-05-09
tjruwase
tjruwase commented on 2023-05-09
jomayeri resolving pr comments
385222b5
jomayeri Merge branch 'master' into jomayeri/issue-3006
d5191f25
tjruwase
tjruwase approved these changes on 2023-05-10
tjruwase Merge branch 'master' into jomayeri/issue-3006
eda531ac
jomayeri Merge branch 'master' into jomayeri/issue-3006
b7b847b5
tjruwase Merge branch 'master' into jomayeri/issue-3006
81599329
jomayeri Merge branch 'master' into jomayeri/issue-3006
1924784b
tjruwase Merge branch 'master' into jomayeri/issue-3006
58e0115f
jomayeri jomayeri enabled auto-merge (squash) 2 years ago
jomayeri Merge branch 'master' into jomayeri/issue-3006
3b0c0ded
tjruwase Merge branch 'master' into jomayeri/issue-3006
c5846340
jomayeri jomayeri merged 9685eb92 into master 2 years ago
stas00
mrwyattii mrwyattii deleted the jomayeri/issue-3006 branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum