xla
71f9a350 - Minor fix: ZeRO-1 grad clipping (#4796)

Commit

2 years ago

Minor fix: ZeRO-1 grad clipping (#4796) implementation and test in previous PR #4648 reduce local norm across shards

References

Author

hgt312

Parents