DeepSpeed
79b81eda - Enable memory efficient linear when ZeRO 3 model is initialized in Stage 3 initialize instead of using deepspeed.init

Commit

5 years ago

Enable memory efficient linear when ZeRO 3 model is initialized in Stage 3 initialize instead of using deepspeed.init

References

Author

samyam

Parents