DeepSpeed
Fix the half-precision version of CPU-Adam
#2032
Merged

Fix the half-precision version of CPU-Adam #2032

RezaYazdaniAminabadi merged 10 commits into master from cpu-adam/fix-half
RezaYazdaniAminabadi
Fix the half-precision version of CPU-Adam
853bbfc2
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from jeffra jeffra 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from samyam samyam 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from tjruwase tjruwase 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from ShadenSmith ShadenSmith 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from conglongli conglongli 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from awan-10 awan-10 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from cli99 cli99 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from eltonzheng eltonzheng 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from minjiaz minjiaz 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from duli2012 duli2012 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from mrwyattii mrwyattii 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from yaozhewei yaozhewei 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from arashb arashb 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from xiaoxiawu-microsoft xiaoxiawu-microsoft 3 years ago
remove unexpected return
e14250cf
fix the increase width (fp32/fp16)
2299511a
jeffra support fp16 tests for cpu-adam
ca9992d8
fix the fp16 data-loading
7d76c101
change unit-test for fp16 check & slight change to parameter size
391142fd
RezaYazdaniAminabadi Merge branch 'master' into cpu-adam/fix-half
da9763ac
tjruwase
tjruwase approved these changes on 2022-06-22
tjruwase Merge branch 'master' into cpu-adam/fix-half
a6e69597
tjruwase Merge branch 'master' into cpu-adam/fix-half
9557a08c
mrwyattii fix for numpy error
cf346127
RezaYazdaniAminabadi RezaYazdaniAminabadi merged a04480e1 into master 3 years ago
mrwyattii mrwyattii deleted the cpu-adam/fix-half branch 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone