bigscience-workshop/Megatron-DeepSpeed

Pull Requests Commits
start using GPTMegLMHeadModel + cleanup
stas00 committed 4 years ago
2e4d03b8
Merge remote-tracking branch 'origin/main' into test-conversion
stas00 committed 4 years ago
f6fb7ef0
backward compatibility for new chkpt keys (#147)
stas00 committed 4 years ago
Verified f5b5d39e
Merge remote-tracking branch 'origin/main' into test-conversion
stas00 committed 4 years ago
da8eb1c0
wip - please ignore
stas00 committed 4 years ago
cc9f37dd
[Feature] Porting bitsandbytes to meg-deepspeed (#144)
wade3han committed 4 years ago
Verified 2004ef1a
Configure code style formatters (#130)
jaketae committed 4 years ago
Verified d0799e7c
Merge remote-tracking branch 'origin/main' into test-conversion
stas00 committed 4 years ago
412053d5
print number of params only on rank 0 (#140)
stas00 committed 4 years ago
Verified 3b22aa21
run on pull_request branch (#141)
stas00 committed 4 years ago
Verified 162ffdb0
[codecarbon] switch to master (#135)
stas00 committed 4 years ago
Verified e1574ce3
[codecarbon] switch to master (#135)
stas00 committed 4 years ago
Verified 93ab439a
Fix deepspeed prefix-lm (#107)
thomasw21 committed 4 years ago
Verified da31db64
[CL] fix default placement (#133)
stas00 committed 4 years ago
Verified b5098e68
Curriculum learning support (#132)
conglongli committed 4 years ago
Verified 0035f06a
reorg
stas00 committed 4 years ago
43881ff5
fixes
stas00 committed 4 years ago
7ec77f8e
fix: only trigger ci on .py file changes (#131)
jaketae committed 4 years ago
Verified b416c8d0
cleanup
stas00 committed 4 years ago
88cfb89a
sync with the new hf conv script
stas00 committed 4 years ago
15944112
move library files into library
stas00 committed 4 years ago
9bb52ff7
Merge remote-tracking branch 'origin/main' into test-conversion
stas00 committed 4 years ago
01a2ce87
simplify fp32 setup
stas00 committed 4 years ago
87d997fb
proper fix for relative imports
stas00 committed 4 years ago
6488fd48
localize the impact of torch.backends.cudnn.deterministic
stas00 committed 4 years ago
41015baf
massage
stas00 committed 4 years ago
32734c3b
new requirement
stas00 committed 4 years ago
2b277b85
massage
stas00 committed 4 years ago
bfcba280
Save tokenizer in conversion script (#128)
jaketae committed 4 years ago
Verified 23dded08
refactor + fp16 test, 1 fail for ds_to_hf fp16
sIncerass committed 4 years ago
301c3115
Terms Of Use Privacy Policy Refund Policy Impressum