Megatron-DeepSpeed
extend preprocess_data.py to support merging datasets
#13
Merged

extend preprocess_data.py to support merging datasets #13

stas00
stas00 extend preprocess_data.py to support merging datasets
96ee4f7d
stas00 stas00 merged 18201ce4 into main 4 years ago
stas00 stas00 deleted the pre-process-merge branch 4 years ago
thomasw21
thomasw21 commented on 2021-07-25

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone