bigscience-workshop/Megatron-DeepSpeed

Pull Requests Commits
Merge remote-tracking branch 'origin/main' into ds_ckpt_reshape
stas00 committed 3 years ago
9edd9393
Add bias a weight we need to sync as well (#307)
thomasw21 committed 3 years ago
Verified 0d0d84c8
Combine Specs (#304)
Muennighoff committed 3 years ago
Verified c3be5d3f
Add support for weighted train (#299)
thomasw21 committed 3 years ago
Verified 43ab0e08
MTF train script (#295)
thomasw21 committed 3 years ago
Verified 3d5d1514
test against the right DS branch
stas00 committed 3 years ago
90d720c0
Merge remote-tracking branch 'origin/main' into ds_ckpt_reshape
stas00 committed 3 years ago
9fa081b2
sync layer norms (#272)
stas00 committed 3 years ago
Verified e1c479e5
CI fixes (#302)
stas00 committed 3 years ago
Verified 0cb043cf
MTF dataset and packing (#293)
thomasw21 committed 3 years ago
Verified c5b88fb9
Merge MLM too fast 2 (#294)
thomasw21 committed 3 years ago
Verified 131bd43e
allow inspection on a machine w/o gpus
stas00 committed 3 years ago
d845a1f0
Merge remote-tracking branch 'origin/main' into ds_ckpt_reshape
stas00 committed 3 years ago
9bb3dc33
Eval harness (#212)
DanielHesslow committed 3 years ago
Verified 3ab0ad18
Fixed MLM dataset arguments(#290)
thomasw21 committed 3 years ago
Verified 55f8cf8b
Mlm adaptation (#287)
Lintang Sutawika committed 3 years ago
Verified 9d264312
Fix DS init (#285)
Quentin-Anthony committed 3 years ago
Verified 987663c1
Cleanup
tjruwase committed 3 years ago
a247614b
Parallel slice merging
tjruwase committed 3 years ago
e8a1ccf1
parameterize
stas00 committed 3 years ago
721380b2
rename
stas00 committed 3 years ago
bca5af4e
close+join pool; add tqdm; comment out noise
stas00 committed 3 years ago
04d9ad0f
Parallelize shard extraction
tjruwase committed 3 years ago
cc8810be
Fix tflops glu computation (#283)
Muennighoff committed 3 years ago
Verified e23393fb
args should be required, don't create another latest file
stas00 committed 3 years ago
795fedbb
Debug functions
tjruwase committed 3 years ago
55bb5148
WIP
tjruwase committed 3 years ago
7ae002d3
WIP
tjruwase committed 3 years ago
3bf14fdf
WIP
tjruwase committed 3 years ago
dd0aeb67
WIP
tjruwase committed 3 years ago
f29bacc1
Terms Of Use Privacy Policy Refund Policy Impressum