DeepSpeed
9f7126fc - Refactor moe/non-moe gradient reduction (#1811)

Commit

3 years ago

Refactor moe/non-moe gradient reduction (#1811)

References

#1811 - Refactor moe/non-moe gradient reduction

Author

tjruwase

tjruwase

Parents

Loading