DeepSpeed
Universal Checkpoint for Sequence Parallelism
#4752
Merged

Commits
  • Extend universal checkpointing to support ds seq parallelism
    samadejacobs committed 2 years ago
  • Remove debug statements
    samadejacobs committed 2 years ago
  • Remove debug statements
    samadejacobs committed 2 years ago
  • Remove pipeline_parallel flag
    samadejacobs committed 2 years ago
  • Fix formatting
    samadejacobs committed 2 years ago
  • formatting
    mrwyattii committed 2 years ago
  • Merge branch 'master' into universal_ckpt_sp
    mrwyattii committed 2 years ago
  • Update deepspeed_checkpoint.py
    samadejacobs committed 2 years ago
  • Merge branch 'master' into universal_ckpt_sp
    samadejacobs committed 2 years ago
  • Merge branch 'master' into universal_ckpt_sp
    mrwyattii committed 2 years ago
Loading