Reshape deepspeed checkpoint #239
stas00
merged
39 commits into
main
from
ds_ckpt_reshape
Reshape deepspeed checkpoint
67c08f09
Merge remote-tracking branch 'origin/main' into ds_ckpt_reshape
fec1ec5f
add checkpoint tests
675f12ca
stas00
commented
on 2022-01-25
stas00
commented
on 2022-01-25
Validate input folder
e379065b
Tests for tp/pp reshape
a1068e4d
tjruwase
commented
on 2022-01-25
remove debug folders
115bd313
fix test_checkpoint_reshaping_empty_dir
cc2fad1f
stas00
commented
on 2022-01-25
stas00
commented
on 2022-01-25
stas00
commented
on 2022-01-25
Fix unit tests
b6733d57
Remove deepspeed checkpoint utils
9bf7ac51
Use DS 3D reshaping utils
29ca2bcc
Merge remote-tracking branch 'origin/main' into ds_ckpt_reshape
a3ef7783
convert to bf16
6d863582
wip universal chkpt
804b497d
rename
c29d3369
rename
9c447933
wip on fragments dealing
7e0a81b9
cleanup
d3005120
Loading universal checkpoint with reshaping
ab0a7f8f
all gpu1<->2 reshapes work
d5e33dec
param attrs
85ff56ca
make the tests adaptable to the number of available gpus
f01fa4a5
WIP
f29bacc1
WIP
dd0aeb67
WIP
3bf14fdf
WIP
7ae002d3
Debug functions
55bb5148
args should be required, don't create another latest file
795fedbb
Parallelize shard extraction
cc8810be
close+join pool; add tqdm; comment out noise
04d9ad0f
rename
bca5af4e
parameterize
721380b2
Parallel slice merging
e8a1ccf1
Cleanup
a247614b
Muennighoff
commented
on 2022-06-23
Merge remote-tracking branch 'origin/main' into ds_ckpt_reshape
9bb3dc33
allow inspection on a machine w/o gpus
d845a1f0
Merge remote-tracking branch 'origin/main' into ds_ckpt_reshape
9fa081b2
test against the right DS branch
90d720c0
Merge remote-tracking branch 'origin/main' into ds_ckpt_reshape
9edd9393
DS size was merged
ebff495c
Login to write a write a comment.
Login via GitHub