PR #6590 Add API for updating ZeRO gradients

Add API for updating ZeRO gradients #6590

tohtana merged 8 commits into master from olruwase/set_zero_opt_grad

Add API for updating ZeRO gradients

18ee6cf2

tjruwase requested a review from

tohtana 1 year ago

tjruwase requested a review from

awan-10 1 year ago

tjruwase requested a review from

loadams 1 year ago

Merge branch 'master' into olruwase/set_zero_opt_grad

6110f70f

tjruwase removed review request from

awan-10 1 year ago

tjruwase removed review request from

loadams 1 year ago

Update docs

c5892847

Format fix

e88cad9d

tohtana commented on 2024-10-02

tohtana commented on 2024-10-04

Update docs; Improve DS logging consistency

1fde1f3a

Merge branch 'master' into olruwase/set_zero_opt_grad

55b558ec

Merge branch 'master' into olruwase/set_zero_opt_grad

021dc0ab

Merge branch 'master' into olruwase/set_zero_opt_grad

5372ee63

tohtana approved these changes on 2024-10-09

tohtana merged 65ab6448 into master 1 year ago

Reviewers

tohtana

Assignees

No one assigned

Labels

None yet

Milestone

No milestone