DeepSpeed
30d97705 - Recover shared parameters (#3033)

Commit

2 years ago

Recover shared parameters (#3033) * submit changes * update format * fix fomrat * revert * test * add top * treat z1 as z2 * revert --------- Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>

References

#3033 - Recover shared parameters

Author

ShijieZZZZ

Parents

4b358333

Files1

deepspeed/utils
- zero_to_fp32.py

DeepSpeed 30d97705 - Recover shared parameters (#3033)

DeepSpeed
30d97705 - Recover shared parameters (#3033)