bigscience-workshop/Megatron-DeepSpeed

Pull Requests Commits
Fix curriculum learning doc (#162)
conglongli committed 4 years ago
Verified 07533d03
remove useless log line (#161)
stas00 committed 4 years ago
Verified 5d64b434
[testing] fix bnb test skipping (#160)
stas00 committed 4 years ago
Verified 3caa50b3
don't save latest_checkpointed_iteration.txt w/ deepspeed (#159)
stas00 committed 4 years ago
Verified ce2d653e
[tests] fix requirements (#158)
stas00 committed 4 years ago
Verified 066c8e4f
Bump minimum version for torch (#156)
thomasw21 committed 4 years ago
Verified 5b20b75c
feature: add debug grad norm cls
Jake Tae committed 4 years ago
222bb0b3
[Logging] Improve logging mechanism (#154)
thomasw21 committed 4 years ago
Verified a82462b7
Fix glu activation (#148)
thomasw21 committed 5 years ago
Verified bdc6ad6d
disable codecarbon as it's very unstable (#152)
stas00 committed 5 years ago
Verified 829cefda
Fix curriculum learning support (#134)
conglongli committed 5 years ago
Verified 8dc8af51
fused softmax layer bug fix sync (#151)
stas00 committed 5 years ago
Verified 9f5f5d4c
backward compatibility for new chkpt keys (#147)
stas00 committed 5 years ago
Verified f5b5d39e
[Feature] Porting bitsandbytes to meg-deepspeed (#144)
wade3han committed 5 years ago
Verified 2004ef1a
Configure code style formatters (#130)
jaketae committed 5 years ago
Verified d0799e7c
print number of params only on rank 0 (#140)
stas00 committed 5 years ago
Verified 3b22aa21
run on pull_request branch (#141)
stas00 committed 5 years ago
Verified 162ffdb0
[codecarbon] switch to master (#135)
stas00 committed 5 years ago
Verified e1574ce3
[codecarbon] switch to master (#135)
stas00 committed 5 years ago
Verified 93ab439a
Fix deepspeed prefix-lm (#107)
thomasw21 committed 5 years ago
Verified da31db64
[CL] fix default placement (#133)
stas00 committed 5 years ago
Verified b5098e68
Curriculum learning support (#132)
conglongli committed 5 years ago
Verified 0035f06a
fix: only trigger ci on .py file changes (#131)
jaketae committed 5 years ago
Verified b416c8d0
Save tokenizer in conversion script (#128)
jaketae committed 5 years ago
Verified 23dded08
[testing] ensure no lock file is dropped (#122)
stas00 committed 5 years ago
Verified 323bf5c3
[Feature] Implement sample-ids-to-text extractor (#116)
wade3han committed 5 years ago
Verified 2f029fa9
chore: update `.gitignore`
jaketae committed 5 years ago
Verified cc20936f
[tests] flush std streams (#120)
stas00 committed 5 years ago
Verified e9b33ee1
ALiBi Implementation (#101)
ofirpress committed 5 years ago
Verified c839a8aa
add shebang
stas00 committed 5 years ago
2f662e84
Terms Of Use Privacy Policy Refund Policy Impressum