[CPU] FusedAdam and CPU training support #3991
tjruwase
merged
24 commits into
deepspeedai:master
from
delock:gma/fused_adam
fused adam can build
abdb08e9
use cpu adam to implement fused adam
f8916365
enable zero stage 1 and 2 for synchronized accelerator (a.k.a. CPU)
c7c2451b
remove unused parameters
49f5e415
Merge branch 'master' into gma/fused_adam
a78c6266
Merge branch 'master' into gma/fused_adam
7c59a379
fix format error
13bc33ad
Remove adam class
6f9d839d
Merge branch 'up-master' into gma/fused_adam
a6ef7c0d
fix format
618936ff
support stage3
10f8b384
tjruwase
commented
on 2023-07-19
tjruwase
commented
on 2023-07-19
tjruwase
commented
on 2023-07-19
reuse simd.h
3c749bdd
fix format
20a7d8d0
make memory_stat return meaningful dict
d77d67b3
Merge branch 'master' into gma/fused_adam
988781b1
Merge branch 'up-master' into gma/fused_adam
041028f3
fix format
4745bdf9
Merge branch 'master' into gma/fused_adam
822e048b
add cpu_adam
4d30d4d0
reuse cpu_adam
06a89fc7
header cleanup
c58c19a5
fix cpu_adam
038d0268
fix format, add missing file
43beb577
Merge branch 'master' into gma/fused_adam
009c5483
tjruwase
approved these changes
on 2023-07-25
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub