DeepSpeed
34704e11 - Merge branch 'master' into yh0903/bf16-release-lp-grads

Commit

9 days ago

Merge branch 'master' into yh0903/bf16-release-lp-grads

References

#8654 - Release each BF16 gradient once immediate_grad_update has accumulated it

Author

tohtana

tohtana

Parents

Loading