DeepSpeed
02477ceb - Prepare gradient handling in zero stage 1 & 2

Commit

319 days ago

Prepare gradient handling in zero stage 1 & 2

References

#7018 - Training multiple models

Author

tjruwase

tjruwase

Parents

Loading