DeepSpeed
8ad187d8 - Universal ckp fixes (#4588)

Commit

1 year ago

Universal ckp fixes (#4588) Signed-off-by: Moshe Island <misland@habana.ai> Co-authored-by: Moshe Island <misland@habana.ai> Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>

References

#4588 - Universal ckp fixes

Author

mosheisland

Parents

1d1a20c5

Files7

deepspeed
- checkpoint
  - constants.py
  - ds_to_universal.py
  - universal_checkpoint.py
- runtime
  - activation_checkpointing
    - checkpointing.py
  - bf16_optimizer.py
  - engine.py
  - fp16
    - fused_optimizer.py

DeepSpeed 8ad187d8 - Universal ckp fixes (#4588)

DeepSpeed
8ad187d8 - Universal ckp fixes (#4588)