onnxruntime
Using standard layernorm cuda kernel for skiplayernorm.
#15076

Merged

Using standard layernorm cuda kernel for skiplayernorm. #15076

yufenglee merged 4 commits into main from zhalei/stable_skip_layernorm

Using standard layernorm cuda kernel for skiplayernorm.

d993649a

zhanghuanrong requested a review from

hariharans29 3 years ago

zhanghuanrong requested a review from

yufenglee 3 years ago

better resource calc.

ac105925

hariharans29 commented on 2023-03-16

zhanghuanrong requested a review from

souptc 3 years ago

zhanghuanrong requested a review from

Lafi7e 3 years ago

Fix no enough resource issue. Ensure power of 2 on the threads_y.

b8182259

Strictly using internal calculation type with gamma and beta.

c6d3e53d

yufenglee approved these changes on 2023-03-23

yufenglee merged 910fc09d into main 3 years ago

yufenglee deleted the zhalei/stable_skip_layernorm branch 3 years ago

Reviewers

yufenglee

hariharans29

souptc

Lafi7e

Assignees

No one assigned

Labels

None yet

Milestone

No milestone