DeepSpeed
Fix partial recovery of sparse_tensor_module_names and dynamically check if gradient data is sparse
#1562

Merged

Fix partial recovery of sparse_tensor_module_names and dynamically check if gradient data is sparse #1562

jeffra merged 7 commits into deepspeedai:master from Dipet:fix_partialy_restore_sparse

Fix partially restore sparse layers

8da73c74

Fix update function for sparse_tensor_module_names

bb296675

Dynamically check is grad data is sparse

b49f779b

Merge Master

b70bdd6f

Dipet requested a review from

awan-10 4 years ago

Dipet requested a review from

cli99 4 years ago

Dipet requested a review from

conglongli 4 years ago

Dipet requested a review from

eltonzheng 4 years ago

Dipet requested a review from

jeffra 4 years ago

Dipet requested a review from

minjiaz 4 years ago

Dipet requested a review from

niumanar 4 years ago

Dipet requested a review from

RezaYazdaniAminabadi 4 years ago

Dipet requested a review from

samyam 4 years ago

Dipet requested a review from

ShadenSmith 4 years ago

Dipet requested a review from

tjruwase 4 years ago

Fix wrong merge

3a5625db

Merge branch 'master' into fix_partialy_restore_sparse

5554f498

Merge branch 'master' into fix_partialy_restore_sparse

5a83112c

jeffra enabled auto-merge (squash) 4 years ago

jeffra approved these changes on 2021-11-16

jeffra merged 4bf4ab7a into master 4 years ago

Reviewers

jeffra

awan-10

cli99

conglongli

eltonzheng

minjiaz

niumanar

RezaYazdaniAminabadi

samyam

ShadenSmith

tjruwase

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Fix partial recovery of sparse_tensor_module_names and dynamically check if gradient data is sparse #1562 Merged

Fix partial recovery of sparse_tensor_module_names and dynamically check if gradient data is sparse #1562

DeepSpeed
Fix partial recovery of sparse_tensor_module_names and dynamically check if gradient data is sparse
#1562

Merged