DeepSpeed
[CPU] FusedAdam and CPU training support
#3991
Merged

Commits
  • fused adam can build
    delock committed 3 years ago
  • use cpu adam to implement fused adam
    delock committed 3 years ago
  • enable zero stage 1 and 2 for synchronized accelerator (a.k.a. CPU)
    delock committed 3 years ago
  • remove unused parameters
    delock committed 3 years ago
  • Merge branch 'master' into gma/fused_adam
    delock committed 3 years ago
  • Merge branch 'master' into gma/fused_adam
    delock committed 3 years ago
  • fix format error
    delock committed 3 years ago
  • Remove adam class
    delock committed 3 years ago
  • Merge branch 'up-master' into gma/fused_adam
    delock committed 3 years ago
  • fix format
    delock committed 3 years ago
  • support stage3
    delock committed 3 years ago
  • reuse simd.h
    delock committed 3 years ago
  • fix format
    delock committed 3 years ago
  • make memory_stat return meaningful dict
    delock committed 3 years ago
  • Merge branch 'master' into gma/fused_adam
    delock committed 3 years ago
  • Merge branch 'up-master' into gma/fused_adam
    delock committed 3 years ago
  • fix format
    delock committed 3 years ago
  • Merge branch 'master' into gma/fused_adam
    delock committed 3 years ago
  • add cpu_adam
    delock committed 3 years ago
  • reuse cpu_adam
    delock committed 3 years ago
  • header cleanup
    delock committed 3 years ago
  • fix cpu_adam
    delock committed 3 years ago
  • fix format, add missing file
    delock committed 3 years ago
  • Merge branch 'master' into gma/fused_adam
    tjruwase committed 3 years ago
Loading