Support `modules_to_save` config option when using DeepSpeed ZeRO-3 with ZeRO init enabled. #1450
Update other.py
13264a20
Update other.py
0e1b5fab
fix quality
bf65be02
Update other.py
be8a0f11
pacman100
marked this pull request as ready for review 1 year ago
pacman100
merged
a1c472f0
into main 1 year ago
pacman100
deleted the smangrul/fix-modules-to-save-for-ds-z3-init branch 1 year ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub