transformers
e95bcaee - fix ds z3 checkpointing when `stage3_gather_16bit_weights_on_model_save=False` (#25817)

Commit

2 years ago

fix ds z3 checkpointing when `stage3_gather_16bit_weights_on_model_save=False` (#25817) * fix ds z3 checkpointing when `stage3_gather_16bit_weights_on_model_save=False` * refactoring

References

#25817 - fix ds z3 checkpointing when `stage3_gather_16bit_weights_on_model_save=False`

Author

pacman100

Parents

f8468b4f

transformers e95bcaee - fix ds z3 checkpointing when `stage3_gather_16bit_weights_on_model_save=False` (#25817)

transformers
e95bcaee - fix ds z3 checkpointing when `stage3_gather_16bit_weights_on_model_save=False` (#25817)