DeepSpeed
fix: fix BF16_Optimizer compatibility issue
#2152
Merged

fix: fix BF16_Optimizer compatibility issue #2152

shjwudp
shjwudp fix: fix BF16_Optimizer compatibility issue with optimizer state 0-di…
256e07b6
shjwudp shjwudp requested a review from jeffra jeffra 3 years ago
shjwudp shjwudp requested a review from samyam samyam 3 years ago
shjwudp shjwudp requested a review from tjruwase tjruwase 3 years ago
shjwudp shjwudp requested a review from ShadenSmith ShadenSmith 3 years ago
shjwudp shjwudp requested a review from conglongli conglongli 3 years ago
shjwudp shjwudp requested a review from awan-10 awan-10 3 years ago
shjwudp shjwudp requested a review from cli99 cli99 3 years ago
shjwudp shjwudp requested a review from eltonzheng eltonzheng 3 years ago
shjwudp shjwudp requested a review from minjiaz minjiaz 3 years ago
shjwudp shjwudp requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
shjwudp shjwudp requested a review from duli2012 duli2012 3 years ago
shjwudp shjwudp requested a review from mrwyattii mrwyattii 3 years ago
shjwudp shjwudp requested a review from yaozhewei yaozhewei 3 years ago
shjwudp shjwudp requested a review from arashb arashb 3 years ago
shjwudp shjwudp requested a review from xiaoxiawu-microsoft xiaoxiawu-microsoft 3 years ago
shjwudp shjwudp requested a review from samadejacobs samadejacobs 3 years ago
tjruwase Merge branch 'master' into fix_bf16_with_adafactor
74e0380f
tjruwase
shjwudp
tjruwase
tjruwase approved these changes on 2022-07-28
tjruwase
tjruwase tjruwase merged 57140e8e into master 3 years ago

Login to write a write a comment.

Login via GitHub