DeepSpeed
CUDA optional deepspeed ops
#2507
Merged

CUDA optional deepspeed ops #2507

tjruwase merged 65 commits into master from olruwase/cuda_optional_ops
tjruwase
CPU-Adam: add compile-flag to enable param-copy from CPU to GPU
7f811bf0
guarde the CUDA-related include files and variables
2422ddf7
tjruwase Merge branch 'master' into cpu-adam/optional_CUDA-copy
e181f455
RezaYazdaniAminabadi Merge branch 'master' into cpu-adam/optional_CUDA-copy
248bb35c
remove CUDA dependency from op_builder when building against CPU
2d8b7df4
RezaYazdaniAminabadi Merge branch 'master' into cpu-adam/optional_CUDA-copy
8ce051cf
fixing the builder issues
6eda1447
fix formatting
71a4d3d4
RezaYazdaniAminabadi Merge branch 'master' into cpu-adam/optional_CUDA-copy
52f7f7bc
return true when there is no mismatch on the cuda version
ee35deb7
guard for when cuda is not available & test with cpu-only environment
8950731e
RezaYazdaniAminabadi Merge branch 'master' into cpu-adam/optional_CUDA-copy
04d76d59
tjruwase Update cpu_adam and cpu_adagrad
56250076
tjruwase merge with master
f30dffad
tjruwase tjruwase requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
tjruwase tjruwase requested a review from jeffra jeffra 3 years ago
tjruwase tjruwase requested a review from samyam samyam 3 years ago
tjruwase tjruwase requested a review from ShadenSmith ShadenSmith 3 years ago
tjruwase tjruwase requested a review from conglongli conglongli 3 years ago
tjruwase tjruwase requested a review from awan-10 awan-10 3 years ago
tjruwase tjruwase requested a review from cli99 cli99 3 years ago
tjruwase tjruwase requested a review from eltonzheng eltonzheng 3 years ago
tjruwase tjruwase requested a review from minjiaz minjiaz 3 years ago
tjruwase tjruwase requested a review from duli2012 duli2012 3 years ago
tjruwase tjruwase requested a review from mrwyattii mrwyattii 3 years ago
tjruwase tjruwase requested a review from yaozhewei yaozhewei 3 years ago
tjruwase tjruwase requested a review from arashb arashb 3 years ago
tjruwase tjruwase requested a review from xiaoxiawu-microsoft xiaoxiawu-microsoft 3 years ago
tjruwase tjruwase requested a review from samadejacobs samadejacobs 3 years ago
tjruwase tjruwase requested a review from cmikeh2 cmikeh2 3 years ago
tjruwase tjruwase requested a review from GuanhuaWang GuanhuaWang 3 years ago
tjruwase Format fixes
52ef0ead
tjruwase Add configurable half precision type; Build/run in CUDA environment
472c7ba1
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
70a0598b
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
bf3ca2ff
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
142fb21b
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
63ef769d
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
b031aa93
tjruwase Run cpu_adam and cpu_adagrad in cpu only environment
c7ae7d1a
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
7dabb629
tjruwase Mark CUDA only unit tests
1d9c9ac3
tjruwase Merge branch 'olruwase/cuda_optional_ops' of github.com:microsoft/Dee…
291fb135
tjruwase CPU environment CI
f19532e0
tjruwase Format fixes
5c85a752
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
f26bf960
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
69730796
tjruwase tjruwase removed review request from arashb arashb 3 years ago
tjruwase tjruwase removed review request from cmikeh2 cmikeh2 3 years ago
tjruwase tjruwase removed review request from duli2012 duli2012 3 years ago
tjruwase tjruwase removed review request from samyam samyam 3 years ago
tjruwase tjruwase removed review request from conglongli conglongli 3 years ago
tjruwase tjruwase removed review request from awan-10 awan-10 3 years ago
tjruwase tjruwase removed review request from GuanhuaWang GuanhuaWang 3 years ago
tjruwase tjruwase removed review request from samadejacobs samadejacobs 3 years ago
tjruwase tjruwase removed review request from cli99 cli99 3 years ago
tjruwase tjruwase removed review request from yaozhewei yaozhewei 3 years ago
tjruwase tjruwase removed review request from eltonzheng eltonzheng 3 years ago
tjruwase tjruwase removed review request from minjiaz minjiaz 3 years ago
tjruwase tjruwase removed review request from xiaoxiawu-microsoft xiaoxiawu-microsoft 3 years ago
tjruwase Remove --forked
980e994a
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
99c47164
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
26a719e7
tjruwase Add --forked
fdb5c4c0
tjruwase Merge branch 'olruwase/cuda_optional_ops' of github.com:microsoft/Dee…
0589fc15
tjruwase CPU only CI should pass
214f2c8a
tjruwase Format fixes
7fd2d261
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
6241f44b
tjruwase Format fixes
c3a39997
tjruwase Merge branch 'olruwase/cuda_optional_ops' of github.com:microsoft/Dee…
613ca7e6
tjruwase Remove scattered pytest.skip
fea4d85f
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
5ed6ef1b
tjruwase Fix cpu_adam unit test
8ca082d1
tjruwase Merge branch 'olruwase/cuda_optional_ops' of github.com:microsoft/Dee…
8da0c267
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
86d72a4e
jeffra
jeffra approved these changes on 2022-12-21
jeffra Merge branch 'master' into olruwase/cuda_optional_ops
7fe7d500
mrwyattii
mrwyattii requested changes on 2022-12-21
tjruwase Update .github/workflows/nv-torch-latest-cpu.yml
1ebb1304
tjruwase Update .github/workflows/nv-torch-latest-cpu.yml
7c14844d
tjruwase Address PR feedback
e1f73725
mrwyattii
mrwyattii approved these changes on 2022-12-21
tjruwase OpenMP linking
3583f97f
tjruwase Rebase
58d41068
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
f654f6a0
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
fcf8c333
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
813dbba2
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
f5a44d36
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
ca9ffd30
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
b94c878d
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
a8abd7c6
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
9b344a2f
tjruwase Fix unit tests
93bc3384
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
fbde29cc
tjruwase Resolve conflict
3aead39b
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
dc7017f2
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
4aaf7887
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
5e2d5567
tjruwase Merge branch 'master' into olruwase/cuda_optional_ops
4d470472
tjruwase tjruwase merged 3f210c97 into master 2 years ago
mrwyattii mrwyattii deleted the olruwase/cuda_optional_ops branch 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone