DeepSpeed
[MiCS] [Fix] saving and loading model checkpoint logic for MiCS sharding
#3440
Merged

[MiCS] [Fix] saving and loading model checkpoint logic for MiCS sharding #3440

tjruwase merged 28 commits into deepspeedai:master from dmlc:mics-fix-ckpt
zarzen
zarzen fix mics save checkpoint hanging
85f5159f
Merge branch 'master' into mics-fix-ckpt
4440c561
Merge branch 'master' of https://github.com/dmlc/DeepSpeed into mics-…
8d15a359
MiCS load_checkpoint
6081de17
copyright
9bbc91a0
zarzen zarzen requested a review from jeffra jeffra 3 years ago
zarzen zarzen requested a review from tjruwase tjruwase 3 years ago
zarzen zarzen requested a review from mrwyattii mrwyattii 3 years ago
zarzen zarzen requested a review from samyam samyam 3 years ago
zarzen zarzen changed the title [MiCS] [Bug] Fix saving and loading model checkpoint logic for MiCS sharding [MiCS] [Fix] saving and loading model checkpoint logic for MiCS sharding 3 years ago
fix for torch-1.9.0
794e47a6
zarzen zarzen requested a review from awan-10 awan-10 3 years ago
zarzen Merge branch 'master' into mics-fix-ckpt
93a5e0d4
zarzen
zarzen Merge branch 'master' into mics-fix-ckpt
d0bc46ed
zarzen
zarzen Merge branch 'master' into mics-fix-ckpt
a6d8d192
zarzen Merge branch 'master' into mics-fix-ckpt
05f73f36
zarzen Merge branch 'master' into mics-fix-ckpt
cda203f2
zarzen Merge branch 'master' into mics-fix-ckpt
aa09d7e0
zarzen Merge branch 'master' into mics-fix-ckpt
7a01c3f2
Naming alignment
c538630e
zarzen Merge branch 'master' into mics-fix-ckpt
48480167
zarzen Merge branch 'master' into mics-fix-ckpt
0a14b0ec
zarzen Merge branch 'master' into mics-fix-ckpt
feda694e
zarzen Merge branch 'master' into mics-fix-ckpt
d77790ba
zarzen Merge branch 'master' into mics-fix-ckpt
6d41beed
zarzen Merge branch 'master' into mics-fix-ckpt
72540bb9
zarzen
tjruwase
tjruwase commented on 2023-05-30
tjruwase
tjruwase commented on 2023-05-30
adding more test conditions for mics shard size
bd001b0d
zarzen Merge branch 'master' into mics-fix-ckpt
fb248180
test with different shard sizes
c9580a53
Merge branch 'mics-fix-ckpt' of https://github.com/dmlc/DeepSpeed int…
c4f9eef9
tjruwase
tjruwase approved these changes on 2023-05-31
zarzen Merge branch 'master' into mics-fix-ckpt
6c8c8af1
adding assertion for better error msg
52a4e9e2
tjruwase tjruwase enabled auto-merge (squash) 3 years ago
disabled auto-merge 3 years ago
Manually disabled by user
tjruwase
zarzen Merge branch 'master' into mics-fix-ckpt
7236d2c0
zarzen
zarzen Merge branch 'master' into mics-fix-ckpt
debb7ce9
tjruwase tjruwase merged c88af214 into master 3 years ago
zarzen zarzen deleted the mics-fix-ckpt branch 3 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone