Megatron-DeepSpeed
Curriculum learning support
#132
Merged
Overview
Commits
20
Changes
View On GitHub

Curriculum learning support #132

stas00 merged 20 commits into bigscience-workshop:main from main
conglongli
conglongli CL initial commit
99d2b37d
conglongli CL+PP support
4c9c4a39
conglongli update
82a31984
stas00
stas00 requested changes on 2021-10-09
stas00
stas00 commented on 2021-10-09
conglongli Apply suggestions from code review
21e91b97
conglongli apply code review comments
6010a3dd
stas00 make it easier to read large numbers
405c7a69
stas00
stas00 commented on 2021-10-09
stas00 add a cl test
a90d30eb
stas00
conglongli apply review comments
fb04d2be
stas00
stas00 commented on 2021-10-09
conglongli Update examples/curriculum_learning/README.md
8e4a4660
stas00 Merge branch 'main' of https://github.com/conglongli/Megatron-DeepSpe…
3ed70757
stas00 update
d86a4f42
stas00 fix
e5a335dd
stas00 new requirement
0c4073b6
stas00
stas00 commented on 2021-10-09
conglongli Update megatron/learning_rates.py
d25fa9e0
conglongli Update megatron/learning_rates.py
7cd53dc0
stas00 fix samples and tokens - thank you Conglong
5a492b34
conglongli fix truncation
8ca1db7f
stas00 stas00 requested a review from stas00 stas00 4 years ago
stas00
stas00 approved these changes on 2021-10-09
stas00 switch to deepspeed@master
d7301a1b
stas00 extend the doc
dbf8abdd
stas00 Trigger CI
b7fd67ed
stas00
stas00 stas00 merged 0035f06a into main 4 years ago
thomasw21
thomasw21 commented on 2021-10-20

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum