DeepSpeed
Add 1-bit Adam support to DeepSpeed
#380
Merged
Overview
Commits
36
Changes
View On GitHub

Add 1-bit Adam support to DeepSpeed #380

jeffra merged 36 commits into master from staging-1bit-adam-v2
awan-10
awan-10 1-bit adam (#353)
fa66867a
jeffra updated launcher to support pdsh and openmpi (#375)
45619afa
jeffra revert timer and update args
6ae04375
jeffra add mvapich to launcher
036a96c8
jeffra update parse args
dce677e6
jeffra convert ordered dict to list before indexing
4fa6e058
jeffra cleanup
2fdb79d1
jeffra update default launcher envs to include mpi vars
1d6d5f50
awan-10 awan-10 requested a review from arashashari arashashari 5 years ago
awan-10 awan-10 requested a review from cli99 cli99 5 years ago
awan-10 awan-10 requested a review from conglongli conglongli 5 years ago
awan-10 awan-10 requested a review from eltonzheng eltonzheng 5 years ago
awan-10 awan-10 requested a review from jeffra jeffra 5 years ago
awan-10 awan-10 requested a review from minjiaz minjiaz 5 years ago
awan-10 awan-10 requested a review from niumanar niumanar 5 years ago
awan-10 awan-10 requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 5 years ago
awan-10 awan-10 requested a review from samyam samyam 5 years ago
awan-10 awan-10 requested a review from ShadenSmith ShadenSmith 5 years ago
awan-10 awan-10 requested a review from tjruwase tjruwase 5 years ago
jeffra Merge branch 'master' into staging-1bit-adam-v2
b3894e84
jeffra address comments on launcher
65564e56
jeffra Merge branch 'staging-1bit-adam-v2' of github.com:microsoft/DeepSpeed…
402dccd7
awan-10 Add a new test.
0bab5784
awan-10 Merge branch 'staging-1bit-adam-v2' of github.com:microsoft/DeepSpeed…
f358e6af
awan-10 Crucial fix in testing code.
cae1acc8
awan-10 Fix formatting.
efe71b47
awan-10 Merge branch 'staging-1bit-adam-v2' of github.com:microsoft/DeepSpeed…
1a124c44
awan-10 Fix formatting.
5ecdcf0a
awan-10 Seperate host and cuda tests for ease of use.
847447bd
jeffra Merge branch 'master' into staging-1bit-adam-v2
cdc18185
jeffra update copyright
03e99db1
jeffra Merge branch 'staging-1bit-adam-v2' of github.com:microsoft/DeepSpeed…
769d9b56
awan-10 Significantly enhance the tutorial for 1-bit Adam.
ba787c24
awan-10 Merge branch 'staging-1bit-adam-v2' of github.com:microsoft/DeepSpeed…
9cb5134a
awan-10 Fix typo.Fix typo.
f6235170
jeffra install openmpi in conda
eb47cdfc
jeffra Merge branch 'staging-1bit-adam-v2' of github.com:microsoft/DeepSpeed…
0ac97ea2
jeffra Update azure-pipelines.yml
2b9d9c8b
jeffra update basic install test
5e33b08f
jeffra small update to getting started docs
8adb63dc
jeffra Merge branch 'staging-1bit-adam-v2' of github.com:microsoft/DeepSpeed…
a76d2a2d
jeffra formatting
66931590
jeffra output env
e944d223
awan-10 Fix initializer.
ded0475e
jeffra
jeffra approved these changes on 2020-09-09
jeffra Update setup.py
07fe5829
jeffra Update azure-pipelines.yml
15d2abea
jeffra Merge branch 'master' into staging-1bit-adam-v2
6df3dbb3
jeffra jeffra merged 01726ce2 into master 5 years ago
jeffra jeffra deleted the staging-1bit-adam-v2 branch 5 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum