DeepSpeed
Use amp autocast in ZeRO3 linear
#990
Merged
Overview
Commits
15
Changes
View On GitHub

Use amp autocast in ZeRO3 linear #990

tjruwase merged 15 commits into master from olruwase/zero3_amp_autocast
tjruwase
tjruwase Use amp autocast in ZeRO3 linear
8d340d05
tjruwase tjruwase requested a review from ShadenSmith ShadenSmith 4 years ago
tjruwase tjruwase requested a review from jeffra jeffra 4 years ago
tjruwase tjruwase requested a review from samyam samyam 4 years ago
tjruwase tjruwase requested a review from arashashari arashashari 4 years ago
tjruwase tjruwase requested a review from awan-10 awan-10 4 years ago
tjruwase tjruwase requested a review from cli99 cli99 4 years ago
tjruwase tjruwase requested a review from conglongli conglongli 4 years ago
tjruwase tjruwase requested a review from eltonzheng eltonzheng 4 years ago
tjruwase tjruwase requested a review from minjiaz minjiaz 4 years ago
tjruwase tjruwase requested a review from niumanar niumanar 4 years ago
tjruwase tjruwase requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 4 years ago
tjruwase Merge branch 'master' into olruwase/zero3_amp_autocast
a48b85df
tjruwase Fix typo
6b8f4868
tjruwase Merge branch 'olruwase/zero3_amp_autocast' of github.com:microsoft/De…
0bc57183
tjruwase Handle specific exceptions
592f11ff
tjruwase CI breaks on torch.distributed
4d55855c
tjruwase Merge branch 'master' into olruwase/zero3_amp_autocast
fe89f5e5
tjruwase Merge branch 'master' into olruwase/zero3_amp_autocast
046d97ac
ShadenSmith
ShadenSmith approved these changes on 2021-04-22
jeffra Merge branch 'master' into olruwase/zero3_amp_autocast
6742f30f
jeffra
jeffra approved these changes on 2021-04-22
tjruwase Add autocast unit test
7aefbfdf
tjruwase Merge branch 'olruwase/zero3_amp_autocast' of github.com:microsoft/De…
3bb825b8
tjruwase Merge branch 'master' into olruwase/zero3_amp_autocast
41d6313c
tjruwase Format fixes
3002983c
tjruwase Merge branch 'olruwase/zero3_amp_autocast' of github.com:microsoft/De…
7d9d8c6a
tjruwase Fix skip logic
c47bd9f0
tjruwase
tjruwase tjruwase merged e88ebbcf into master 4 years ago
xingchensong

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum