bigscience-workshop/Megatron-DeepSpeed

Pull Requests Commits

Merge branch 'megatron-2.4-ds-pipe' of github.com:microsoft/Megatron-DeepSpeed into megatron-2.4-ds-pipe

Shaden Smith committed 4 years ago

346b89a6

DS checkponiting, ZeRO incoming

Shaden Smith committed 4 years ago

311e56c0

jeffra committed 4 years ago

b737bb82

jeffra committed 4 years ago

b1c15719

add git info for megatron + ds_report

jeffra committed 4 years ago

5ef22584

Merge pull request #13 from jeffra/olruwase/megatron-2.4_dse

tjruwase committed 4 years ago

Verified 846415c9

Remove dead code

tjruwase committed 4 years ago

9dd7d9eb

tjruwase committed 4 years ago

c88c876e

Running with ZeRO3

tjruwase committed 4 years ago

745d74c4

Shaden Smith committed 4 years ago

ae6d7977

Shaden Smith committed 4 years ago

9f0a49dc

pipeline parallelism integration

Shaden Smith committed 4 years ago

8a132ced

ZeRO Integration

tjruwase committed 4 years ago

f52dbd04

jeffra committed 4 years ago

e5eda7e2

jeffra committed 4 years ago

9b3a43f7

Merge branch 'github-main' into 'main'

jaredcasper committed 4 years ago

42c1cf42

Merge internal main and github main back into one branch.

jaredcasper committed 4 years ago

5d65de54

Merge branch 'readme_fix' into 'main'

jaredcasper committed 4 years ago

27b6c876

One more quick fix.

jaredcasper committed 4 years ago

657d7cdc

Merge branch 'readme_fix' into 'main'

jaredcasper committed 4 years ago

3f38ecf1

Quick fix of copy/paste error.

jaredcasper committed 4 years ago

edb76abe

Merge branch 'preprocess_fix' into 'main'

shoeybi committed 4 years ago

bba90f79

Add arg needed for tokenizer.

jaredcasper committed 4 years ago

2c247afb

Merge branch 'numpy_seed' into 'main'

jaredcasper committed 4 years ago

37475717

Ensure numpy random seed is within range.

jaredcasper committed 4 years ago

1c4c360f

Merge branch 'arg_checks' into 'main'

shoeybi committed 4 years ago

002cde6b

Merge branch 't5_docs' into 'main'

jaredcasper committed 4 years ago

78bad983

Adding T5 to docs and a bit of cleanup.

jaredcasper committed 4 years ago

306eb24e

Update arguments checks.

jaredcasper committed 4 years ago

8044c7b4

Merge branch 'v0_checkpoint_fixes' into 'main'

jaredcasper committed 4 years ago

ee76a501

Older