PR #12363 Refine gradient accumulation (on device training)

Refine gradient accumulation (on device training) #12363

pengwa merged 11 commits into master from pengwa/inplace_acc

bed1f8c2

optimize inplace accumulator a bit

950c864e

fix inputs

8e96b0b4

revert logging

59f453ad

minor fix

061232b2

pengwa requested a review from

askhade 3 years ago

pengwa requested a review from

baijumeswani 3 years ago

pengwa requested a review from

ashbhandare 3 years ago

pengwa added training

baijumeswani commented on 2022-07-28

tune perf and resolve comments

ca0fbde0

Merge branch 'master' of https://github.com/microsoft/onnxruntime int…

7249c2d2

typo

55bb9e25

fix

5a5c809e

fix tests

f873ee4a

baijumeswani commented on 2022-07-29

baijumeswani dismissed these changes on 2022-07-29

move threshold to constexpr.

0c9b693c

pengwa dismissed their stale review via 0c9b693c 3 years ago

baijumeswani approved these changes on 2022-07-29

pengwa merged 6d1eb950 into master 3 years ago

pengwa deleted the pengwa/inplace_acc branch 3 years ago

Reviewers

baijumeswani

askhade

ashbhandare

Assignees

No one assigned

Labels

training

Milestone

No milestone

onnxruntime Refine gradient accumulation (on device training) #12363 Merged

Refine gradient accumulation (on device training) #12363

onnxruntime
Refine gradient accumulation (on device training)
#12363

Merged