DeepSpeed
Add APIs to offload states of model, optimizer, and engine
#6011
Merged
Overview
Commits
28
Changes
View On GitHub
Commits
  • add apis to offload states of model, optimizer, and engine
    Masahiro Tanaka committed 2 years ago
  • update api doc
    Masahiro Tanaka committed 2 years ago
  • Merge branch 'master' into tohtana/offload_zero_buffers
    tohtana committed 2 years ago
  • reduce global reference to buffer
    Masahiro Tanaka committed 2 years ago
  • loosen type hint
    Masahiro Tanaka committed 2 years ago
  • Merge branch 'master' into tohtana/offload_zero_buffers
    Masahiro Tanaka committed 2 years ago
  • add option for pin_memory and non blocking copy
    Masahiro Tanaka committed 2 years ago
  • fix offloading of lp grad
    Masahiro Tanaka committed 2 years ago
  • add verification in test
    Masahiro Tanaka committed 2 years ago
  • improve offloading of lp params
    Masahiro Tanaka committed 2 years ago
  • Merge branch 'master' into tohtana/offload_zero_buffers
    tohtana committed 2 years ago
  • fix pinning
    Masahiro Tanaka committed 2 years ago
  • Merge branch 'master' into tohtana/offload_zero_buffers
    tohtana committed 2 years ago
  • resolve conflict
    Masahiro Tanaka committed 2 years ago
  • Merge branch 'master' into tohtana/offload_zero_buffers
    tohtana committed 2 years ago
  • fix method name and enum key
    Masahiro Tanaka committed 2 years ago
  • elimitate duplicated buffer for lp param
    Masahiro Tanaka committed 2 years ago
  • simplified offloding of adam states
    Masahiro Tanaka committed 2 years ago
  • validate devcies of offload states
    Masahiro Tanaka committed 2 years ago
  • add document
    Masahiro Tanaka committed 2 years ago
  • Merge branch 'master' into tohtana/offload_zero_buffers
    loadams committed 2 years ago
  • fix usage example
    Masahiro Tanaka committed 2 years ago
  • Merge branch 'tohtana/offload_zero_buffers' of github.com:microsoft/DeepSpeed into tohtana/offload_zero_buffers
    Masahiro Tanaka committed 2 years ago
  • Merge branch 'master' into tohtana/offload_zero_buffers
    tohtana committed 2 years ago
  • Merge branch 'master' into tohtana/offload_zero_buffers
    tohtana committed 2 years ago
  • Merge branch 'master' into tohtana/offload_zero_buffers
    tohtana committed 2 years ago
  • Merge branch 'master' into tohtana/offload_zero_buffers
    tohtana committed 2 years ago
  • Merge branch 'master' into tohtana/offload_zero_buffers
    tjruwase committed 1 year ago
FAQ Terms Privacy Refunds Impressum
Loading