onnxruntime
Simplified layer norm changes
#5028
Merged
Overview
Commits
22
Changes
View On GitHub

Simplified layer norm changes #5028

jingyanwangms merged 22 commits into master from jingywa/t5-layer-norm
jingyanwangms
t5 layer norm changes
a2271f94
add t5 layer norm kernel
7cad39a8
ashbhandare
ashbhandare commented on 2020-09-03
use template for t5 layer norm
f05155ba
template definition changes
4c306f0c
no build error
08fe5d58
add CPU cuda kernel
b3f30d37
first unit test
03320992
other forward unit tests
5a5be7c3
add T5LayerNormGrad
c41675ca
ashbhandare Add c++ transform and test for T5 LN
d24b8e49
jingyanwangms jingyanwangms marked this pull request as ready for review 5 years ago
jingyanwangms jingyanwangms requested a review 5 years ago
ashbhandare
ashbhandare commented on 2020-09-16
fix and some debug prints
a3fa1c1a
SherlockNoMad SherlockNoMad added training
SherlockNoMad
fix cuda error
d4dbaca5
jingyanwangms jingyanwangms changed the title [WIP] t5 layer norm changes T5 layer norm changes 5 years ago
jingyanwangms jingyanwangms changed the title T5 layer norm changes Simplied layer norm changes 5 years ago
jingyanwangms jingyanwangms changed the title Simplied layer norm changes Simplified layer norm changes 5 years ago
rename from t5 to simplified
9b394b36
ytaous
ytaous dismissed these changes on 2020-09-23
SherlockNoMad
SherlockNoMad commented on 2020-09-23
SherlockNoMad
SherlockNoMad commented on 2020-09-23
SherlockNoMad
SherlockNoMad commented on 2020-09-23
SherlockNoMad
SherlockNoMad commented on 2020-09-23
SherlockNoMad
SherlockNoMad commented on 2020-09-23
SherlockNoMad
SherlockNoMad commented on 2020-09-23
SherlockNoMad
SherlockNoMad commented on 2020-09-23
SherlockNoMad
SherlockNoMad
SherlockNoMad commented on 2020-09-23
ashbhandare
ashbhandare commented on 2020-09-23
ashbhandare
ashbhandare commented on 2020-09-23
ashbhandare
ashbhandare commented on 2020-09-23
ashbhandare
ashbhandare commented on 2020-09-23
ashbhandare
ashbhandare commented on 2020-09-23
ashbhandare
ashbhandare commented on 2020-09-23
ashbhandare
ashbhandare commented on 2020-09-23
ashbhandare
ashbhandare commented on 2020-09-23
ashbhandare
ashbhandare commented on 2020-09-23
ashbhandare
ashbhandare commented on 2020-09-23
ashbhandare
ashbhandare commented on 2020-09-23
ashbhandare
PR comments
ca792af8
jingyanwangms jingyanwangms dismissed their stale review via ca792af8 5 years ago
revert change on invertible LM code path
e5d42739
remove duplicate forward computation
9246afe9
add GradientCheckerTest.SimplifiedLayerNormGrad
75fb9ba3
ytaous
ytaous commented on 2020-10-01
jingyanwangms
change back macro
212629dd
jingyanwangms
ashbhandare
ashbhandare commented on 2020-10-01
SherlockNoMad
SherlockNoMad commented on 2020-10-02
SherlockNoMad
SherlockNoMad commented on 2020-10-02
SherlockNoMad
SherlockNoMad commented on 2020-10-02
Fix SimplifiedLayerNorm Gradient
8310e2ac
ytaous
ytaous commented on 2020-10-09
merge with Sherlockss changes
165a653f
changed cuda kernel
26651be6
reapply cpu kernel changes
24853399
ytaous
ytaous approved these changes on 2020-10-10
SherlockNoMad
SherlockNoMad commented on 2020-10-12
SherlockNoMad
SherlockNoMad approved these changes on 2020-10-12
jingyanwangms jingyanwangms merged 20c47ce9 into master 5 years ago
jingyanwangms jingyanwangms deleted the jingywa/t5-layer-norm branch 5 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
training
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum