DeepSpeed
ba39d7d0 - Create optimizer state for only trainable parameters

Commit

3 years ago

Create optimizer state for only trainable parameters

References

olruwase/zero2_trainable_parameters_v0.5.7

Author

tjruwase

tjruwase

Parents

Files2

deepspeed/runtime/zero
- stage1.py
- stage2.py