bigscience-workshop/Megatron-DeepSpeed

Pull Requests Commits
Add emission & example file
Muennighoff committed 3 years ago
1fa06184
Merge MLM too fast 2 (#294)
thomasw21 committed 3 years ago
Verified 131bd43e
Remove superfluous string
Muennighoff committed 3 years ago
2ce9ff67
Remove duplicates
Muennighoff committed 3 years ago
0214bb77
Merge branch 'main' into bseval_harness
Muennighoff committed 3 years ago
e81615e5
Remove superfluous script
Muennighoff committed 3 years ago
6fd4646b
Add bseval_harness fork compatibility
Muennighoff committed 3 years ago
72447451
Eval harness (#212)
DanielHesslow committed 3 years ago
Verified 3ab0ad18
Fixed MLM dataset arguments(#290)
thomasw21 committed 3 years ago
Verified 55f8cf8b
Mlm adaptation (#287)
Lintang Sutawika committed 3 years ago
Verified 9d264312
Fix DS init (#285)
Quentin-Anthony committed 3 years ago
Verified 987663c1
Fix tflops glu computation (#283)
Muennighoff committed 3 years ago
Verified e23393fb
[valid] deadlock workaround (#282)
stas00 committed 3 years ago
Verified cb48bd2c
Add run_evalharness-tr11-176b-ml slurm script
Muennighoff committed 3 years ago
1d6c630a
Parse args prior to loading function to get load_path
Muennighoff committed 3 years ago
db203cce
Extract args.load prior to load_ds_checkpoint_and_setup_megatron
Muennighoff committed 3 years ago
50820352
Fix adaptive_seq_len via resetting activation shape
Muennighoff committed 3 years ago
f3307058
Add arg to reduce bubble for pipeline parallel
Muennighoff committed 3 years ago
1c11b107
Add backup file
Muennighoff committed 3 years ago
213317f1
Intermediate results flag
Muennighoff committed 3 years ago
3f18e7be
Explain bootstrap_iters flag
Muennighoff committed 3 years ago
7bf75b94
Add bootstrap_iters arg
Muennighoff committed 3 years ago
f75e2326
make the default path unique to avoid overwrite
stas00 committed 3 years ago
45bd9c65
Fix mixed fused layer norm to mimick nn.LayerNorm for torch>1.11 (#281)
thomasw21 committed 3 years ago
Verified 908dc9cb
sort skip_keys
stas00 committed 3 years ago
5884dcf3
Update CODEOWNERS
TevenLeScao committed 3 years ago
Verified c85b7c25
Update CODEOWNERS
TevenLeScao committed 3 years ago
Verified b6266f55
Update CODEOWNERS
TevenLeScao committed 3 years ago
Verified c6f22c41
disable sanity check on layers-2%pp==0
stas00 committed 3 years ago
a798d69f
skip --abort_on_unmet_fused_kernel_constraints during eval
stas00 committed 3 years ago
8ef90184
Terms Of Use Privacy Policy Refund Policy Impressum