bigscience-workshop/Megatron-DeepSpeed

Pull Requests Commits

Merge remote-tracking branch 'origin/main' into test-conversion

stas00 committed 4 years ago

c923cda4

add layernorm in Embedding (#191)

stas00 committed 4 years ago

Verified b1359ee0

Support skip iteration flag (#177)

jaketae committed 4 years ago

Verified 106a9a6f

Full seqlen eval for CL+PP (#187)

conglongli committed 4 years ago

Verified 2105ff38

[BNB] integrate `StableEmbeding` into `VocabParallelEmbedding` logic (#182)

stas00 committed 4 years ago

Verified a34ca7f2

[PrefixLM] Figuring out why prefix lm is doing poorly on short context (#169)

thomasw21 committed 4 years ago

Verified 6d146b5f

[CI] improvements (#185)

stas00 committed 4 years ago

Verified 590f3e27

Alternative fix to TP > 1 (#178)

thomasw21 committed 4 years ago

Verified 2d9744f2

Fixed TP > 1 issue with new validation scheme

TevenLeScao committed 4 years ago

b982e040

simplifying tests

TevenLeScao committed 4 years ago

b1fc4927

Fixed merge oversight in tensorboard logs

TevenLeScao committed 4 years ago

18b704e1

Adding language specific validation sets for Multilingual model training (#97)

hadyelsahar committed 4 years ago

Verified 846c0879

Fix prefix lm offsets (#167)

thomasw21 committed 4 years ago

Verified 5e1f2101

Update main.yml (#172)

stas00 committed 4 years ago

Verified 5df29b5d

[CI] fix ci / update packages (#170)

stas00 committed 4 years ago

Verified b39dd1cf

Merge remote-tracking branch 'origin/main' into test-conversion

stas00 committed 4 years ago

3fc0ce3b

[checkpoint] only one latest file (#164)

stas00 committed 4 years ago

Verified 45dcd528

Merge remote-tracking branch 'origin/main' into test-conversion

stas00 committed 4 years ago

f0429465

Fix curriculum learning doc (#162)

conglongli committed 4 years ago

Verified 07533d03

remove useless log line (#161)

stas00 committed 4 years ago

Verified 5d64b434

[testing] fix bnb test skipping (#160)

stas00 committed 4 years ago

Verified 3caa50b3

don't save latest_checkpointed_iteration.txt w/ deepspeed (#159)

stas00 committed 4 years ago

Verified ce2d653e

[tests] fix requirements (#158)

stas00 committed 4 years ago

Verified 066c8e4f

Bump minimum version for torch (#156)

thomasw21 committed 4 years ago

Verified 5b20b75c

Merge remote-tracking branch 'origin/main' into test-conversion

stas00 committed 4 years ago

642c6d89

[Logging] Improve logging mechanism (#154)

thomasw21 committed 4 years ago

Verified a82462b7

Fix glu activation (#148)

thomasw21 committed 4 years ago

Verified bdc6ad6d

disable codecarbon as it's very unstable (#152)

stas00 committed 4 years ago

Verified 829cefda

Fix curriculum learning support (#134)

conglongli committed 4 years ago

Verified 8dc8af51

fused softmax layer bug fix sync (#151)

stas00 committed 4 years ago

Verified 9f5f5d4c

Older