bigscience-workshop/Megatron-DeepSpeed

Pull Requests Commits
another comment
TevenLeScao committed 4 years ago
56dc51d4
fixed misleading comments
TevenLeScao committed 4 years ago
db307537
trying to make code clearer
TevenLeScao committed 4 years ago
cf59b436
fixed print_rank_0 flush
TevenLeScao committed 4 years ago
4e2794b6
valid-data arg to valid-data-path
TevenLeScao committed 4 years ago
b0777bdb
print to print_rank_0
TevenLeScao committed 4 years ago
861e60f0
removed some debug
TevenLeScao committed 4 years ago
57c255f4
more flexibility in how to use validation sets
TevenLeScao committed 4 years ago
3c252b60
small test model
TevenLeScao committed 4 years ago
68150246
bash script for dummy test
sbmaruf committed 4 years ago
8f8dd8ac
implement valid data-loader
sbmaruf committed 4 years ago
c2ad1b59
Add argument --valid-data
sbmaruf committed 4 years ago
d8f4efd5
add shebang
stas00 committed 4 years ago
2f662e84
make scripts executable
stas00 committed 4 years ago
26f18b5a
update merge_preprocessed_data to use distributed merge (#82)
adammoody committed 4 years ago
Verified 0c820648
training with dummy data to verify sampling (#36)
lintangsutawika committed 4 years ago
Verified 28fd70ad
add direct meg-ds to hf format script (part2) (#111)
stas00 committed 4 years ago
Verified d6c2a803
add direct meg-ds to hf format script (#110)
stas00 committed 4 years ago
Verified bea5ded0
Checkpoint conversion tools (#14) (#109)
stas00 committed 4 years ago
Verified bc9c951a
[tensor comparisons] support pt-1.8, add torch_assert_close (#106)
stas00 committed 4 years ago
Verified fc8820ca
Fix model tests (#103)
thomasw21 committed 4 years ago
Verified 48dcee4a
simplify the CI trigger (#102)
stas00 committed 4 years ago
Verified 0f82f40b
Prefix lm (#52)
thomasw21 committed 4 years ago
Verified 68b46f20
check whether python3-config is available (#98)
stas00 committed 4 years ago
Verified 648ee17f
added comment
TevenLeScao committed 4 years ago
a7609226
Floating-point ops counting and reloading (#40)
TevenLeScao committed 4 years ago
Verified af8229e2
[WIP] [codecarbon] sorting out CC warnings + logger preamble (#80)
stas00 committed 4 years ago
Verified 7cd2b85a
[requirements] fix format (#94)
stas00 committed 4 years ago
Verified a42a398a
[CI] setting up a CI with EC2 backend (#78)
stas00 committed 4 years ago
Verified 9e14c02a
add missing dependencies (#88)
stas00 committed 4 years ago
Verified b4cc77fe
Terms Of Use Privacy Policy Refund Policy Impressum