DeepSpeed
Make bf16_optimizer work for non pipeline parallelism
#2470
Merged
Overview
Commits
4
Changes
View On GitHub

Make bf16_optimizer work for non pipeline parallelism #2470

tjruwase merged 4 commits into master from olruwase/bf16_optimizer_access
tjruwase
tjruwase Make bf16_optimizer work for non pipeline
db19f0c7
tjruwase tjruwase requested a review from jomayeri jomayeri 3 years ago
tjruwase tjruwase requested a review from jeffra jeffra 3 years ago
tjruwase tjruwase requested a review from samyam samyam 3 years ago
tjruwase tjruwase requested a review from ShadenSmith ShadenSmith 3 years ago
tjruwase tjruwase requested a review from conglongli conglongli 3 years ago
tjruwase tjruwase requested a review from awan-10 awan-10 3 years ago
tjruwase tjruwase requested a review from cli99 cli99 3 years ago
tjruwase tjruwase requested a review from eltonzheng eltonzheng 3 years ago
tjruwase tjruwase requested a review from minjiaz minjiaz 3 years ago
tjruwase tjruwase requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
tjruwase tjruwase requested a review from duli2012 duli2012 3 years ago
tjruwase tjruwase requested a review from mrwyattii mrwyattii 3 years ago
tjruwase tjruwase requested a review from yaozhewei yaozhewei 3 years ago
tjruwase tjruwase requested a review from arashb arashb 3 years ago
tjruwase tjruwase requested a review from xiaoxiawu-microsoft xiaoxiawu-microsoft 3 years ago
tjruwase tjruwase requested a review from samadejacobs samadejacobs 3 years ago
tjruwase tjruwase requested a review from cmikeh2 cmikeh2 3 years ago
tjruwase tjruwase requested a review from GuanhuaWang GuanhuaWang 3 years ago
jomayeri
jomayeri approved these changes on 2022-11-03
jeffra
tjruwase Merge branch 'master' into olruwase/bf16_optimizer_access
15612773
tjruwase Merge branch 'master' into olruwase/bf16_optimizer_access
922d9f82
tjruwase Merge branch 'master' into olruwase/bf16_optimizer_access
aeb28568
tjruwase tjruwase merged ee39187d into master 3 years ago
mrwyattii mrwyattii deleted the olruwase/bf16_optimizer_access branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum