DeepSpeed
Add ZenFlow code for Stage 3
#7516
Merged
Overview
Commits
17
Changes
View On GitHub
Commits
  • Add support for ZenFlow with ZeRO-Stage 3
    JoshWoo2003 committed 1 year ago
  • Add ZenFlow Optimizer to support ZeRO-Stage 3
    JoshWoo2003 committed 1 year ago
  • Format code
    JoshWoo2003 committed 1 year ago
  • Fix ZeRO-Offload init bug with missing `zenflow` argument
    JoshWoo2003 committed 1 year ago
  • Resolve merge conflicts and update ZenFlow Stage 3 affinity
    JoshWoo2003 committed 1 year ago
  • Merge branch 'master' into zenflow_zero3
    sfc-gh-truwase committed 1 year ago
  • Refactor ZenFlowSelectiveAdamW to unify temp_copy_param logic
    JoshWoo2003 committed 1 year ago
  • Merge remote-tracking branch 'origin/zenflow_zero3' into zenflow_zero3
    JoshWoo2003 committed 1 year ago
  • Refactor ZenFlowSelectiveAdamW to unify group_step logic
    JoshWoo2003 committed 1 year ago
  • Merge branch 'master' into zenflow_zero3
    sfc-gh-truwase committed 1 year ago
  • Refactor: deduplicate process setup and add clarifying comments
    JoshWoo2003 committed 1 year ago
  • Merge branch 'zenflow_zero3' of https://github.com/JoshWoo2003/DeepSpeed into zenflow_zero3
    JoshWoo2003 committed 1 year ago
  • Merge branch 'master' into zenflow_zero3
    sfc-gh-truwase committed 1 year ago
  • Merge branch 'master' into zenflow_zero3
    sfc-gh-truwase committed 1 year ago
  • Merge branch 'master' into zenflow_zero3
    sfc-gh-truwase committed 1 year ago
  • Fix: bugs in zf_torch_adam unit test
    JoshWoo2003 committed 1 year ago
  • Merge branch 'master' into zenflow_zero3
    sfc-gh-truwase committed 1 year ago
FAQ Terms Privacy Refunds Impressum
Loading