DeepSpeed
1-bit LAMB optimizer
#970
Merged

Commits
  • initial commit
    conglongli committed 4 years ago
  • make build test work
    conglongli committed 4 years ago
  • unit test
    conglongli committed 4 years ago
  • put scaling coeff inside state
    conglongli committed 4 years ago
  • add unit test
    conglongli committed 4 years ago
  • add unit test
    conglongli committed 4 years ago
  • check DeepSpeedEngine.enable_backward_allreduce at CheckOverflow.has_overflow()
    conglongli committed 4 years ago
  • doc
    conglongli committed 4 years ago
  • resolve merge conflict
    conglongli committed 4 years ago
  • doc
    conglongli committed 4 years ago
  • var name change
    conglongli committed 4 years ago
  • Onebitadam + Pipeline Parallel fixes (#972)
    sdtblck committed 4 years ago
  • polish pipeline parallel support
    conglongli committed 4 years ago
  • pipeline support unit test
    conglongli committed 4 years ago
  • Merge branch 'master' into staging-1bit-lamb
    conglongli committed 4 years ago
  • Merge branch 'master' into staging-1bit-lamb
    conglongli committed 4 years ago
  • doc fix
    conglongli committed 4 years ago
  • Merge branch 'master' into staging-1bit-lamb
    conglongli committed 4 years ago
  • Merge branch 'master' into staging-1bit-lamb
    jeffra committed 4 years ago
  • handle pipeline case correctly
    conglongli committed 4 years ago
  • Merge branch 'staging-1bit-lamb' of github.com:microsoft/DeepSpeed into staging-1bit-lamb
    conglongli committed 4 years ago
  • Merge branch 'master' into staging-1bit-lamb
    jeffra committed 4 years ago
  • different way to check pipeline
    conglongli committed 4 years ago
  • Merge branch 'staging-1bit-lamb' of github.com:microsoft/DeepSpeed into staging-1bit-lamb
    conglongli committed 4 years ago
  • add doc
    conglongli committed 4 years ago
  • Merge branch 'master' into staging-1bit-lamb
    conglongli committed 4 years ago
Loading