Fix curriculum learning support #134
stas00
merged
26 commits into
bigscience-workshop:main
from
main
CL initial commit
99d2b37d
CL+PP support
4c9c4a39
update
82a31984
Apply suggestions from code review
21e91b97
apply code review comments
6010a3dd
make it easier to read large numbers
405c7a69
add a cl test
a90d30eb
apply review comments
fb04d2be
Update examples/curriculum_learning/README.md
8e4a4660
Merge branch 'main' of https://github.com/conglongli/Megatron-DeepSpe…
3ed70757
update
d86a4f42
fix
e5a335dd
new requirement
0c4073b6
Update megatron/learning_rates.py
d25fa9e0
Update megatron/learning_rates.py
7cd53dc0
fix samples and tokens - thank you Conglong
5a492b34
fix truncation
8ca1db7f
switch to deepspeed@master
d7301a1b
extend the doc
dbf8abdd
Trigger CI
b7fd67ed
merge upstream
c0ec861c
fix CL+PP
20d498d7
rollback accidental changes
f4c4eb34
relax assertion for corner case
df7a9d95
backward compatibility for new chkpt keys
ae24cd18
Merge remote-tracking branch 'upstream/main' into main
3e521045
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub