bigscience-workshop/Megatron-DeepSpeed

Pull Requests Commits
remove debug
Shaden Smith committed 4 years ago
ae6d7977
run script
Shaden Smith committed 4 years ago
9f0a49dc
pipeline parallelism integration
Shaden Smith committed 4 years ago
8a132ced
ZeRO Integration
tjruwase committed 4 years ago
f52dbd04
add ds changes
jeffra committed 4 years ago
e5eda7e2
add ds changes
jeffra committed 4 years ago
9b3a43f7
Merge branch 'github-main' into 'main'
jaredcasper committed 4 years ago
42c1cf42
Merge internal main and github main back into one branch.
jaredcasper committed 4 years ago
5d65de54
Merge branch 'readme_fix' into 'main'
jaredcasper committed 4 years ago
27b6c876
One more quick fix.
jaredcasper committed 4 years ago
657d7cdc
Merge branch 'readme_fix' into 'main'
jaredcasper committed 4 years ago
3f38ecf1
Quick fix of copy/paste error.
jaredcasper committed 4 years ago
edb76abe
Merge branch 'preprocess_fix' into 'main'
shoeybi committed 4 years ago
bba90f79
Add arg needed for tokenizer.
jaredcasper committed 4 years ago
2c247afb
Merge branch 'numpy_seed' into 'main'
jaredcasper committed 4 years ago
37475717
Ensure numpy random seed is within range.
jaredcasper committed 4 years ago
1c4c360f
Merge branch 'arg_checks' into 'main'
shoeybi committed 4 years ago
002cde6b
Merge branch 't5_docs' into 'main'
jaredcasper committed 4 years ago
78bad983
Adding T5 to docs and a bit of cleanup.
jaredcasper committed 4 years ago
306eb24e
Update arguments checks.
jaredcasper committed 4 years ago
8044c7b4
Merge branch 'v0_checkpoint_fixes' into 'main'
jaredcasper committed 4 years ago
ee76a501
fixed compatiblity with v0 checkpoints
shoeybi committed 4 years ago
26b49aab
Merge branch 't5_merge' into 'main'
shoeybi committed 4 years ago
2ff004ac
Merge branch 'main_generate' into 'main'
jaredcasper committed 4 years ago
716a3243
Merge branch 'main_dedup' into 'main'
jaredcasper committed 4 years ago
7a5768ac
addressed comments
mpatwary committed 4 years ago
e5ec27d7
addressed comments
mpatwary committed 4 years ago
5a6431f5
addressed comments
mpatwary committed 4 years ago
5c2ce593
addressed reviews
Mostofa Patwary committed 4 years ago
0fa728ac
added more comments
Mostofa Patwary committed 4 years ago
f938e19a
Terms Of Use Privacy Policy Refund Policy Impressum