bigscience-workshop/Megatron-DeepSpeed

Pull Requests Commits
Remove codecarbon
thomasw21 committed 3 years ago
c6f9c021
Woops
thomasw21 committed 3 years ago
23d3f4ca
Woops
thomasw21 committed 3 years ago
fab9fb96
Be very careful of random states
thomasw21 committed 3 years ago
f713ff01
Woops
thomasw21 committed 3 years ago
94ef27ad
Enable CarbonEmissionTracker
thomasw21 committed 3 years ago
5868d295
Disable CarbonEmissionTracker
thomasw21 committed 3 years ago
1476691b
Woops
thomasw21 committed 3 years ago
48892b93
Black list all tasks that require greedy_until
thomasw21 committed 3 years ago
b2caf4dd
add offloading possitility
thomasw21 committed 3 years ago
6a326afa
That pathing breaks everything
thomasw21 committed 3 years ago
fae49cab
Update position ids
thomasw21 committed 3 years ago
1423bf9f
Missing import
thomasw21 committed 3 years ago
f34841cd
Add bs eval harness code
thomasw21 committed 3 years ago
73a79476
Position offset
thomasw21 committed 3 years ago
d45af145
Woops
thomasw21 committed 3 years ago
17a075d2
WTF
thomasw21 committed 3 years ago
01e269d8
Update model loading
thomasw21 committed 3 years ago
dff9766f
Maybe this is what's wrong
thomasw21 committed 3 years ago
b8090b76
Revert "I think OPT doesn't have shared vocabulary embedding"
thomasw21 committed 3 years ago
55d1a4bf
I think OPT doesn't have shared vocabulary embedding
thomasw21 committed 3 years ago
e742a3fe
Test
thomasw21 committed 3 years ago
8e095da2
Run inference for opt
thomasw21 committed 3 years ago
43a9ab44
relu to work
thomasw21 committed 3 years ago
b21d773e
That's what I'm hoping is all I need
thomasw21 committed 3 years ago
ce8d5e11
MTF dataset and packing (#293)
thomasw21 committed 3 years ago
Verified c5b88fb9
Merge MLM too fast 2 (#294)
thomasw21 committed 3 years ago
Verified 131bd43e
Eval harness (#212)
DanielHesslow committed 3 years ago
Verified 3ab0ad18
Fixed MLM dataset arguments(#290)
thomasw21 committed 3 years ago
Verified 55f8cf8b
Mlm adaptation (#287)
Lintang Sutawika committed 3 years ago
Verified 9d264312
Terms Of Use Privacy Policy Refund Policy Impressum