DeepSpeed
Fix wrong idx bug in invertible LayerNormBackward1
#692

Merged

Fix wrong idx bug in invertible LayerNormBackward1 #692

RezaYazdaniAminabadi merged 5 commits into deepspeedai:master from master

fix wrong idx bug in invertible LayerNormBackward1

7d34ca01

Taka152 requested a review from

arashashari 5 years ago

Taka152 requested a review from

awan-10 5 years ago

Taka152 requested a review from

cli99 5 years ago

Taka152 requested a review from

conglongli 5 years ago

Taka152 requested a review from

eltonzheng 5 years ago

Taka152 requested a review from

jeffra 5 years ago

Taka152 requested a review from

minjiaz 5 years ago

Taka152 requested a review from

niumanar 5 years ago

Taka152 requested a review from

RezaYazdaniAminabadi 5 years ago

Taka152 requested a review from

samyam 5 years ago

Taka152 requested a review from

ShadenSmith 5 years ago

Taka152 requested a review from

tjruwase 5 years ago

fix unexpected deletion

525f0d18

RezaYazdaniAminabadi commented on 2021-01-26

fix idx for LayerNormBackward1_fused_add

e97a4814

RezaYazdaniAminabadi approved these changes on 2021-01-26

eltonzheng approved these changes on 2021-01-26

move pos defination in LayerNormBackward1 kernels

f355b31f

fix format error

d125bbef

RezaYazdaniAminabadi merged 5221832e into master 5 years ago

Reviewers

eltonzheng

RezaYazdaniAminabadi

arashashari

awan-10

cli99

conglongli

jeffra

minjiaz

niumanar

samyam

ShadenSmith

tjruwase

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Fix wrong idx bug in invertible LayerNormBackward1 #692 Merged

Fix wrong idx bug in invertible LayerNormBackward1 #692

DeepSpeed
Fix wrong idx bug in invertible LayerNormBackward1
#692

Merged