bigscience-workshop/Megatron-DeepSpeed

Pull Requests Commits

Update requirements.txt (#46)

jaketae committed 4 years ago

Verified f919d0cf

rm `(s)` that slipped through

VictorSanh committed 4 years ago

49b9d7de

Group tensorboard metrics (#39)

VictorSanh committed 4 years ago

Verified 9e75429d

chore: update gitignore (#45)

jaketae committed 4 years ago

Verified 752e958c

fix attn_mask (#50)

stas00 committed 4 years ago

Verified 42fe3b39

add .bs to the version to help check we are on the right repo/branch

stas00 committed 4 years ago

bdef48f7

fix the deepspeed example

stas00 committed 4 years ago

1cef056c

add a section on how we use deepspeed with Meg

stas00 committed 4 years ago

faf9809f

flos re-loading

TevenLeScao committed 4 years ago

60794bf7

Faster preprocessing (#18)

thomasw21 committed 4 years ago

Verified 7b998814

removed slurm_examples

TevenLeScao committed 4 years ago

d5818947

use pp engine even for pp=1 (#6)

jeffra committed 4 years ago

06cb18fa

improve DS integration evaluation + logging

Shaden Smith committed 4 years ago

8382141c

pipe transformer docstring

Shaden Smith committed 4 years ago

b7b3167f

Create README.md

stas00 committed 4 years ago

Verified 6394089f

Revert "Revert "use pp engine even for pp=1 (#6) (#34)""

stas00 committed 4 years ago

781676b5

Revert "use pp engine even for pp=1 (#6) (#34)"

stas00 committed 4 years ago

ad2e3d3a

use pp engine even for pp=1 (#6) (#34)

stas00 committed 4 years ago

Verified 6c6c64ac

Revert "Update gpt2_tokenization.py"

thomasw21 committed 4 years ago

8938d7ac

Update gpt2_tokenization.py

huu4ontocord committed 4 years ago

Verified a40d8163

synched with latest 13B script

TevenLeScao committed 4 years ago

3c79aaca

synched with latest 13B script

TevenLeScao committed 4 years ago

64892e27

fix timing (#31)

stas00 committed 4 years ago

Verified feca57ac

Implement rotary embeddings (#7)

thomasw21 committed 4 years ago

Verified dc4e0cba

adding missing prefix on merge

stas00 committed 4 years ago

5563ec6f

[microsoft/Megatron-DeepSpeed sync] Commits including Jul 26, 2021 (#29)

stas00 committed 4 years ago

Verified 084c3d0c

Fix inconsistent merge (#30)

thomasw21 committed 4 years ago

Verified 0125aaa7

1B3 parameter setup

TevenLeScao committed 4 years ago

97dd06db

1B3 parameter setup

TevenLeScao committed 4 years ago

17e01842

1B3 parameter setup + flos counting

TevenLeScao committed 4 years ago

aefbe3bd

Newer Older