1-bit LAMB optimizer #970
conglongli
merged
26 commits into
master
from
staging-1bit-lamb
initial commit
755860ad
make build test work
cb3760c5
unit test
0ec43974
put scaling coeff inside state
7141b158
add unit test
830bab26
add unit test
e2b09870
check DeepSpeedEngine.enable_backward_allreduce at CheckOverflow.has_…
a1fa9748
doc
5daacfd4
resolve merge conflict
4f9cbe49
doc
99e102dc
var name change
691b6ffb
Onebitadam + Pipeline Parallel fixes (#972)
642dd5a7
polish pipeline parallel support
4831dca9
pipeline support unit test
c0f176d8
Merge branch 'master' into staging-1bit-lamb
e04e5397
Merge branch 'master' into staging-1bit-lamb
ce4c7ea9
awan-10
commented
on 2021-04-19
awan-10
approved these changes
on 2021-04-19
doc fix
0a2b1654
Merge branch 'master' into staging-1bit-lamb
c470e07c
jeffra
commented
on 2021-04-20
jeffra
approved these changes
on 2021-04-20
Merge branch 'master' into staging-1bit-lamb
6953e949
jeffra
commented
on 2021-04-20
handle pipeline case correctly
46892235
Merge branch 'staging-1bit-lamb' of github.com:microsoft/DeepSpeed in…
ba73f26e
jeffra
approved these changes
on 2021-04-20
Merge branch 'master' into staging-1bit-lamb
8f5adfed
different way to check pipeline
d0910069
Merge branch 'staging-1bit-lamb' of github.com:microsoft/DeepSpeed in…
6c647509
add doc
98163e12
Merge branch 'master' into staging-1bit-lamb
08fbc5ab
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub