DeepSpeed
Extend residual_add kernel tests to cover pre_attn_norm
#2354
Merged

Extend residual_add kernel tests to cover pre_attn_norm #2354

jeffra merged 6 commits into master from arashb/res-add-tests-preln
arashb
arashb Extend residual_add kernel tests to conver pre_attn_norm
5fc40576
arashb arashb requested a review from jeffra jeffra 3 years ago
arashb arashb requested a review from samyam samyam 3 years ago
arashb arashb requested a review from tjruwase tjruwase 3 years ago
arashb arashb requested a review from ShadenSmith ShadenSmith 3 years ago
arashb arashb requested a review from conglongli conglongli 3 years ago
arashb arashb requested a review from awan-10 awan-10 3 years ago
arashb arashb requested a review from cli99 cli99 3 years ago
arashb arashb requested a review from eltonzheng eltonzheng 3 years ago
arashb arashb requested a review from minjiaz minjiaz 3 years ago
arashb arashb requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
arashb arashb requested a review from duli2012 duli2012 3 years ago
arashb arashb requested a review from mrwyattii mrwyattii 3 years ago
arashb arashb requested a review from yaozhewei yaozhewei 3 years ago
arashb arashb requested a review from xiaoxiawu-microsoft xiaoxiawu-microsoft 3 years ago
arashb arashb requested a review from samadejacobs samadejacobs 3 years ago
arashb arashb requested a review from cmikeh2 cmikeh2 3 years ago
arashb arashb requested a review from GuanhuaWang GuanhuaWang 3 years ago
arashb arashb changed the title Extend residual_add kernel tests to conver pre_attn_norm Extend residual_add kernel tests to cover pre_attn_norm 3 years ago
arashb Merge branch 'master' into arashb/res-add-tests-preln
ffac603c
awan-10
awan-10 approved these changes on 2022-09-26
arashb Merge branch 'master' into arashb/res-add-tests-preln
f4f077b7
arashb Merge branch 'master' into arashb/res-add-tests-preln
8d09c7cf
arashb Merge branch 'master' into arashb/res-add-tests-preln
45370519
jeffra Merge branch 'master' into arashb/res-add-tests-preln
96fd407c
jeffra
jeffra approved these changes on 2022-09-27
jeffra jeffra merged 79692af1 into master 3 years ago
jeffra jeffra deleted the arashb/res-add-tests-preln branch 3 years ago

Login to write a write a comment.

Login via GitHub