Megatron-DeepSpeed
e8fcbae2 - Seperate merge script from process_data script (#19)

Commit
4 years ago
Seperate merge script from process_data script (#19) * Move merge code to seperate script * Reduce the number of parameters for merge script * Remove level and add TODO to find a way to add it automatically * Remove json_keys as well * Trim away last json_keys * Woops * Fomatting + add comment * typo Co-authored-by: Thomas <รถ95242+thomasw21@users.noreply.github.com>
Author
Parents
Loading