DeepSpeed
Adding Gradient Accumulation Data Type Config
#2512
Merged

Adding Gradient Accumulation Data Type Config #2512

tjruwase merged 16 commits into master from jomayeri/grad-accum-dtype
jomayeri
jomayeri Adding gradient accumulation dtype config.
2cfd271a
jomayeri Merge branch 'master' into jomayeri/grad-accum-dtype
4826161a
jomayeri Switching to new DtypeEnum
71e1653e
jomayeri jomayeri requested a review from jeffra jeffra 3 years ago
jomayeri jomayeri requested a review from samyam samyam 3 years ago
jomayeri jomayeri requested a review from tjruwase tjruwase 3 years ago
jomayeri jomayeri requested a review from ShadenSmith ShadenSmith 3 years ago
jomayeri jomayeri requested a review from conglongli conglongli 3 years ago
jomayeri jomayeri requested a review from awan-10 awan-10 3 years ago
jomayeri jomayeri requested a review from cli99 cli99 3 years ago
jomayeri jomayeri requested a review from eltonzheng eltonzheng 3 years ago
jomayeri jomayeri requested a review from minjiaz minjiaz 3 years ago
jomayeri jomayeri requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
jomayeri jomayeri requested a review from duli2012 duli2012 3 years ago
jomayeri jomayeri requested a review from mrwyattii mrwyattii 3 years ago
jomayeri jomayeri requested a review from yaozhewei yaozhewei 3 years ago
jomayeri jomayeri requested a review from arashb arashb 3 years ago
jomayeri jomayeri requested a review from xiaoxiawu-microsoft xiaoxiawu-microsoft 3 years ago
jomayeri jomayeri requested a review from samadejacobs samadejacobs 3 years ago
jomayeri jomayeri requested a review from cmikeh2 cmikeh2 3 years ago
jomayeri jomayeri requested a review from GuanhuaWang GuanhuaWang 3 years ago
jomayeri jomayeri removed review request from arashb arashb 3 years ago
jomayeri jomayeri removed review request from ShadenSmith ShadenSmith 3 years ago
jomayeri jomayeri removed review request from cmikeh2 cmikeh2 3 years ago
jomayeri jomayeri removed review request from duli2012 duli2012 3 years ago
jomayeri jomayeri removed review request from samyam samyam 3 years ago
jomayeri jomayeri removed review request from conglongli conglongli 3 years ago
jomayeri jomayeri removed review request from GuanhuaWang GuanhuaWang 3 years ago
jomayeri jomayeri removed review request from samadejacobs samadejacobs 3 years ago
jomayeri jomayeri removed review request from cli99 cli99 3 years ago
jomayeri jomayeri removed review request from yaozhewei yaozhewei 3 years ago
jomayeri jomayeri removed review request from eltonzheng eltonzheng 3 years ago
jomayeri jomayeri removed review request from minjiaz minjiaz 3 years ago
jomayeri jomayeri removed review request from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
jomayeri jomayeri removed review request from xiaoxiawu-microsoft xiaoxiawu-microsoft 3 years ago
jomayeri Merge branch 'master' into jomayeri/grad-accum-dtype
a0346c54
jeffra
jeffra commented on 2022-11-17
jeffra
jeffra
jeffra commented on 2022-11-17
mrwyattii
mrwyattii commented on 2022-11-18
jomayeri Adding standalone check function, and unit tests
c8043643
jomayeri Variable disambiguation
ddf1e494
jomayeri Merge branch 'master' into jomayeri/grad-accum-dtype
9f8d9a9e
jomayeri Merge branch 'master' into jomayeri/grad-accum-dtype
6e069f38
jomayeri Adding checks for unsupported states.
ab98f6c8
tjruwase Merge branch 'master' into jomayeri/grad-accum-dtype
a4dac4f5
tjruwase
tjruwase commented on 2022-11-22
tjruwase
tjruwase commented on 2022-11-22
jomayeri Updating for PR comments.
052d822f
jomayeri Merge branch 'master' into jomayeri/grad-accum-dtype
f51d5ae7
jomayeri Merge branch 'jomayeri/grad-accum-dtype' of github.com:microsoft/Deep…
999aa665
tjruwase
tjruwase commented on 2022-11-22
jomayeri Reorganizing unit test.
244360ba
tjruwase
tjruwase approved these changes on 2022-11-22
tjruwase Merge branch 'master' into jomayeri/grad-accum-dtype
2219dc2e
jomayeri Merge branch 'master' into jomayeri/grad-accum-dtype
bf958e7a
tjruwase tjruwase merged 21c28029 into master 3 years ago
mrwyattii mrwyattii deleted the jomayeri/grad-accum-dtype branch 3 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone