DeepSpeed
[MiCS] [Fix] saving and loading model checkpoint logic for MiCS sharding
#3440
Merged
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
28
Changes
View On
GitHub
[MiCS] [Fix] saving and loading model checkpoint logic for MiCS sharding
#3440
tjruwase
merged 28 commits into
deepspeedai:master
from
dmlc:mics-fix-ckpt
fix mics save checkpoint hanging
85f5159f
Merge branch 'master' into mics-fix-ckpt
4440c561
Merge branch 'master' of https://github.com/dmlc/DeepSpeed into mics-…
8d15a359
MiCS load_checkpoint
6081de17
copyright
9bbc91a0
zarzen
requested a review
from
jeffra
3 years ago
zarzen
requested a review
from
tjruwase
3 years ago
zarzen
requested a review
from
mrwyattii
3 years ago
zarzen
requested a review
from
samyam
3 years ago
zarzen
changed the title
[MiCS] [Bug] Fix saving and loading model checkpoint logic for MiCS sharding
[MiCS] [Fix] saving and loading model checkpoint logic for MiCS sharding
3 years ago
fix for torch-1.9.0
794e47a6
zarzen
requested a review
from
awan-10
3 years ago
Merge branch 'master' into mics-fix-ckpt
93a5e0d4
Merge branch 'master' into mics-fix-ckpt
d0bc46ed
Merge branch 'master' into mics-fix-ckpt
a6d8d192
Merge branch 'master' into mics-fix-ckpt
05f73f36
Merge branch 'master' into mics-fix-ckpt
cda203f2
Merge branch 'master' into mics-fix-ckpt
aa09d7e0
Merge branch 'master' into mics-fix-ckpt
7a01c3f2
Naming alignment
c538630e
Merge branch 'master' into mics-fix-ckpt
48480167
Merge branch 'master' into mics-fix-ckpt
0a14b0ec
Merge branch 'master' into mics-fix-ckpt
feda694e
Merge branch 'master' into mics-fix-ckpt
d77790ba
Merge branch 'master' into mics-fix-ckpt
6d41beed
Merge branch 'master' into mics-fix-ckpt
72540bb9
tjruwase
commented on 2023-05-30
tjruwase
commented on 2023-05-30
adding more test conditions for mics shard size
bd001b0d
Merge branch 'master' into mics-fix-ckpt
fb248180
test with different shard sizes
c9580a53
Merge branch 'mics-fix-ckpt' of https://github.com/dmlc/DeepSpeed int…
c4f9eef9
tjruwase
approved these changes on 2023-05-31
Merge branch 'master' into mics-fix-ckpt
6c8c8af1
adding assertion for better error msg
52a4e9e2
tjruwase
enabled auto-merge (squash)
3 years ago
disabled auto-merge
3 years ago
Manually disabled by user
Merge branch 'master' into mics-fix-ckpt
7236d2c0
Merge branch 'master' into mics-fix-ckpt
debb7ce9
tjruwase
merged
c88af214
into master
3 years ago
zarzen
deleted the mics-fix-ckpt branch
3 years ago
Login to write a write a comment.
Login via GitHub
Reviewers
tjruwase
jeffra
mrwyattii
samyam
awan-10
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub