bigscience-workshop/Megatron-DeepSpeed

Pull Requests Commits

handle the case where tp=1

stas00 committed 4 years ago

97379b89

[Feature] Porting bitsandbytes to meg-deepspeed (#144)

wade3han committed 4 years ago

Verified 2004ef1a

Configure code style formatters (#130)

jaketae committed 4 years ago

Verified d0799e7c

print number of params only on rank 0 (#140)

stas00 committed 4 years ago

Verified 3b22aa21

run on pull_request branch (#141)

stas00 committed 4 years ago

Verified 162ffdb0

[codecarbon] switch to master (#135)

stas00 committed 4 years ago

Verified e1574ce3

[codecarbon] switch to master (#135)

stas00 committed 4 years ago

Verified 93ab439a

Fix deepspeed prefix-lm (#107)

thomasw21 committed 4 years ago

Verified da31db64

[CL] fix default placement (#133)

stas00 committed 4 years ago

Verified b5098e68

Curriculum learning support (#132)

conglongli committed 4 years ago

Verified 0035f06a

fix: only trigger ci on .py file changes (#131)

jaketae committed 4 years ago

Verified b416c8d0

Save tokenizer in conversion script (#128)

jaketae committed 4 years ago

Verified 23dded08

[testing] ensure no lock file is dropped (#122)

stas00 committed 4 years ago

Verified 323bf5c3

[Feature] Implement sample-ids-to-text extractor (#116)

wade3han committed 4 years ago

Verified 2f029fa9

chore: update `.gitignore`

jaketae committed 4 years ago

Verified cc20936f

[tests] flush std streams (#120)

stas00 committed 4 years ago

Verified e9b33ee1

ALiBi Implementation (#101)

ofirpress committed 4 years ago

Verified c839a8aa

stas00 committed 4 years ago

2f662e84

make scripts executable

stas00 committed 4 years ago

26f18b5a

update merge_preprocessed_data to use distributed merge (#82)

adammoody committed 4 years ago

Verified 0c820648

training with dummy data to verify sampling (#36)

lintangsutawika committed 4 years ago

Verified 28fd70ad

add direct meg-ds to hf format script (part2) (#111)

stas00 committed 4 years ago

Verified d6c2a803

add direct meg-ds to hf format script (#110)

stas00 committed 4 years ago

Verified bea5ded0

Checkpoint conversion tools (#14) (#109)

stas00 committed 4 years ago

Verified bc9c951a

[tensor comparisons] support pt-1.8, add torch_assert_close (#106)

stas00 committed 4 years ago

Verified fc8820ca

Fix model tests (#103)

thomasw21 committed 4 years ago

Verified 48dcee4a

simplify the CI trigger (#102)

stas00 committed 4 years ago

Verified 0f82f40b

Prefix lm (#52)

thomasw21 committed 4 years ago

Verified 68b46f20

check whether python3-config is available (#98)

stas00 committed 4 years ago

Verified 648ee17f

TevenLeScao committed 4 years ago

a7609226

Older