DeepSpeed
Refactor residual add kernels
#2333
Merged

Refactor residual add kernels #2333

jeffra merged 4 commits into master from arashb/refact-res-add-bias
arashb
arashb Refactor residual add to expose fp16/fp32 kernels at python level
f024542f
cmikeh2
arashb Refactor the in-place tensor update/return
27d2e7b0
arashb
arashb arashb marked this pull request as ready for review 3 years ago
arashb arashb requested a review from jeffra jeffra 3 years ago
arashb arashb requested a review from samyam samyam 3 years ago
arashb arashb requested a review from tjruwase tjruwase 3 years ago
arashb arashb requested a review from ShadenSmith ShadenSmith 3 years ago
arashb arashb requested a review from conglongli conglongli 3 years ago
arashb arashb requested a review from awan-10 awan-10 3 years ago
arashb arashb requested a review from cli99 cli99 3 years ago
arashb arashb requested a review from eltonzheng eltonzheng 3 years ago
arashb arashb requested a review from minjiaz minjiaz 3 years ago
arashb arashb requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
arashb arashb requested a review from duli2012 duli2012 3 years ago
arashb arashb requested a review from mrwyattii mrwyattii 3 years ago
arashb arashb requested a review from yaozhewei yaozhewei 3 years ago
arashb arashb requested a review from xiaoxiawu-microsoft xiaoxiawu-microsoft 3 years ago
arashb arashb requested a review from samadejacobs samadejacobs 3 years ago
arashb arashb requested a review from cmikeh2 cmikeh2 3 years ago
arashb arashb requested a review from GuanhuaWang GuanhuaWang 3 years ago
arashb Fix function input args order
0a681273
arashb arashb force pushed from c7b4f093 to 0a681273 3 years ago
arashb
arashb commented on 2022-09-20
arashb
cmikeh2
cmikeh2 approved these changes on 2022-09-20
awan-10 Merge branch 'master' into arashb/refact-res-add-bias
8a89926c
awan-10
awan-10 approved these changes on 2022-09-21
jeffra
jeffra approved these changes on 2022-09-21
jeffra jeffra merged 48c5220b into master 3 years ago
jeffra jeffra deleted the arashb/refact-res-add-bias branch 3 years ago

Login to write a write a comment.

Login via GitHub