DeepSpeed
4e8f7fff - Link lp/hp/optim state; Refresh links after checkpoint load

Commit

3 years ago

Link lp/hp/optim state; Refresh links after checkpoint load

References

olruwase/bf16_update_hp_params

#1801 - bf16+pipeline parallelism

Author

tjruwase

tjruwase

Parents

Loading