bigscience-workshop/Megatron-DeepSpeed

Pull Requests Commits
install instructions; consistent indent
stas00 committed 4 years ago
7d880b7c
update to deepspeed usage; rm irrelevant info
stas00 committed 4 years ago
c5e0b248
Tiny gpt training script for local testing
TevenLeScao committed 4 years ago
Verified d61ca5c2
HF tokenizers (on the training side) (#5)
TevenLeScao committed 4 years ago
Verified 0b2f0df4
Update README.md
TevenLeScao committed 4 years ago
Verified ca4ea155
Update README.md
TevenLeScao committed 4 years ago
Verified a0ab8f48
Create README for preprocessing
TevenLeScao committed 4 years ago
Verified ebb6a078
Hf tok pipeline (#2)
sbmaruf committed 4 years ago
Verified b1a30de8
add the explanation about the forking problems.
stas00 committed 4 years ago
Verified 5502865b
explain what this repo is about.
stas00 committed 4 years ago
Verified fb1a120f
Merge pull request #1 from microsoft/megatron-2.4-ds-pipe
jeffra committed 4 years ago
Verified b56b50bb
Merge branch 'megatron-2.4-ds-pipe' of github.com:microsoft/Megatron-DeepSpeed into megatron-2.4-ds-pipe
Shaden Smith committed 4 years ago
346b89a6
DS checkponiting, ZeRO incoming
Shaden Smith committed 4 years ago
311e56c0
formatting
jeffra committed 4 years ago
b737bb82
formatting
jeffra committed 4 years ago
b1c15719
add git info for megatron + ds_report
jeffra committed 4 years ago
5ef22584
Merge pull request #13 from jeffra/olruwase/megatron-2.4_dse
tjruwase committed 4 years ago
Verified 846415c9
Remove dead code
tjruwase committed 4 years ago
9dd7d9eb
Fix newline
tjruwase committed 4 years ago
c88c876e
Running with ZeRO3
tjruwase committed 4 years ago
745d74c4
remove debug
Shaden Smith committed 4 years ago
ae6d7977
run script
Shaden Smith committed 4 years ago
9f0a49dc
pipeline parallelism integration
Shaden Smith committed 4 years ago
8a132ced
ZeRO Integration
tjruwase committed 4 years ago
f52dbd04
add ds changes
jeffra committed 4 years ago
e5eda7e2
add ds changes
jeffra committed 4 years ago
9b3a43f7
Merge branch 'github-main' into 'main'
jaredcasper committed 4 years ago
42c1cf42
Merge internal main and github main back into one branch.
jaredcasper committed 4 years ago
5d65de54
Merge branch 'readme_fix' into 'main'
jaredcasper committed 4 years ago
27b6c876
One more quick fix.
jaredcasper committed 4 years ago
657d7cdc
Terms Of Use Privacy Policy Refund Policy Impressum