onnxruntime
Use InplaceClipGradNorm for offline processing for on-device training
#12603

Merged

Use InplaceClipGradNorm for offline processing for on-device training #12603

baijumeswani merged 9 commits into main from bmeswani/clipgradnorm-cpu

baijumeswani added training

baijumeswani requested a review from

askhade 3 years ago

baijumeswani requested a review from

pengwa 3 years ago

baijumeswani requested a review from

ashbhandare 3 years ago

baijumeswani requested a review 3 years ago

pengwa commented on 2022-08-24

pengwa commented on 2022-08-25

pengwa commented on 2022-08-31

pengwa dismissed these changes on 2022-08-31

Add InplaceClipGradNorm CPU kernel

fbe28b04

Update the offline tooling to generate InplaceClipgradNorm

5707824b

Update the Optimizer class to use the TensorSeq inputs for the gradients

49470ecf

Add kernel def hash for InplaceClipGradNorm

7d924d48

Address pull request review comments

bae9ee45

Address pull request review comments

27b36a78

baijumeswani dismissed their stale review via 27b36a78 3 years ago

baijumeswani force pushed from 4429c1d6 to 27b36a78 3 years ago

fix python lint

4610879e

edgchen1 commented on 2022-09-01

Address pull request review comments

71e74c00

edgchen1 commented on 2022-09-01

Update orttraining/orttraining/training_api/optimizer.cc

5ba1d947

edgchen1 approved these changes on 2022-09-02

baijumeswani merged 56bae3b1 into main 3 years ago

baijumeswani deleted the bmeswani/clipgradnorm-cpu branch 3 years ago

Reviewers

edgchen1

pengwa

askhade

ashbhandare

Assignees

No one assigned

Labels

training

Milestone

No milestone

onnxruntime Use InplaceClipGradNorm for offline processing for on-device training #12603 Merged

Use InplaceClipGradNorm for offline processing for on-device training #12603

onnxruntime
Use InplaceClipGradNorm for offline processing for on-device training
#12603

Merged