bigscience-workshop/Megatron-DeepSpeed

Pull Requests Commits

Merge remote-tracking branch 'origin/main' into debug_with_new_dataset

stas00 committed 4 years ago

71a6988c

Update main.yml (#172)

stas00 committed 4 years ago

Verified 5df29b5d

[CI] fix ci / update packages (#170)

stas00 committed 4 years ago

Verified b39dd1cf

[wip] debug with new data

stas00 committed 4 years ago

56049bb0

[checkpoint] only one latest file (#164)

stas00 committed 4 years ago

Verified 45dcd528

Fix curriculum learning doc (#162)

conglongli committed 4 years ago

Verified 07533d03

remove useless log line (#161)

stas00 committed 4 years ago

Verified 5d64b434

[testing] fix bnb test skipping (#160)

stas00 committed 4 years ago

Verified 3caa50b3

don't save latest_checkpointed_iteration.txt w/ deepspeed (#159)

stas00 committed 4 years ago

Verified ce2d653e

[tests] fix requirements (#158)

stas00 committed 4 years ago

Verified 066c8e4f

Bump minimum version for torch (#156)

thomasw21 committed 4 years ago

Verified 5b20b75c

[Logging] Improve logging mechanism (#154)

thomasw21 committed 4 years ago

Verified a82462b7

Fix glu activation (#148)

thomasw21 committed 4 years ago

Verified bdc6ad6d

disable codecarbon as it's very unstable (#152)

stas00 committed 4 years ago

Verified 829cefda

Fix curriculum learning support (#134)

conglongli committed 4 years ago

Verified 8dc8af51

fused softmax layer bug fix sync (#151)

stas00 committed 4 years ago

Verified 9f5f5d4c

backward compatibility for new chkpt keys (#147)

stas00 committed 4 years ago

Verified f5b5d39e

[Feature] Porting bitsandbytes to meg-deepspeed (#144)

wade3han committed 4 years ago

Verified 2004ef1a

Configure code style formatters (#130)

jaketae committed 4 years ago

Verified d0799e7c

print number of params only on rank 0 (#140)

stas00 committed 4 years ago

Verified 3b22aa21

run on pull_request branch (#141)

stas00 committed 4 years ago

Verified 162ffdb0

[codecarbon] switch to master (#135)

stas00 committed 4 years ago

Verified e1574ce3

[codecarbon] switch to master (#135)

stas00 committed 4 years ago

Verified 93ab439a

Fix deepspeed prefix-lm (#107)

thomasw21 committed 4 years ago

Verified da31db64

[CL] fix default placement (#133)

stas00 committed 4 years ago

Verified b5098e68

Curriculum learning support (#132)

conglongli committed 4 years ago

Verified 0035f06a

fix: only trigger ci on .py file changes (#131)

jaketae committed 4 years ago

Verified b416c8d0

Save tokenizer in conversion script (#128)

jaketae committed 4 years ago

Verified 23dded08

[testing] ensure no lock file is dropped (#122)

stas00 committed 4 years ago

Verified 323bf5c3

[Feature] Implement sample-ids-to-text extractor (#116)

wade3han committed 4 years ago

Verified 2f029fa9

Older