DeepSpeed
0a0819b7 - Option to exclude frozen weights for checkpoint save (#3953)

Commit

2 years ago

Option to exclude frozen weights for checkpoint save (#3953) * Option to exclude frozen weights for checkpoint save * Extend unit test * Support PP training

References

#3953 - Option to exclude frozen weights for checkpoint save

Author

tjruwase

Parents

ceccfa3e

DeepSpeed 0a0819b7 - Option to exclude frozen weights for checkpoint save (#3953)

DeepSpeed
0a0819b7 - Option to exclude frozen weights for checkpoint save (#3953)