DeepSpeed
77b649d1 - Clip gradients of last stage tied weights

Commit

3 years ago

Clip gradients of last stage tied weights

References

#1801 - bf16+pipeline parallelism

Author

tjruwase

tjruwase

Parents

Loading