DeepSpeed
[zero_to_fp32] fix shared param recovery
#3407
Merged

[zero_to_fp32] fix shared param recovery #3407

stas00
stas00 [zero_to_fp32] fix shared param recovery
07211839
stas00 stas00 requested a review from jeffra jeffra 2 years ago
stas00 stas00 requested a review from tjruwase tjruwase 2 years ago
stas00 stas00 requested a review from awan-10 awan-10 2 years ago
stas00 cleanup
292dbc8d
stas00 cleanup
02f7d881
stas00 better naming
4a978525
stas00
mayank31398
loadams Merge branch 'master' into zero_to_fp32-shared-param
699d0d8c
tjruwase Merge branch 'master' into zero_to_fp32-shared-param
14b7a416
tjruwase
tjruwase approved these changes on 2023-05-02
tjruwase Merge branch 'master' into zero_to_fp32-shared-param
aab22478
stas00 not all params have ds_id it seems
9da56123
tjruwase Merge branch 'master' into zero_to_fp32-shared-param
9e26717f
tjruwase tjruwase merged 77ebf760 into master 2 years ago
stas00 stas00 deleted the zero_to_fp32-shared-param branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone