Megatron-DeepSpeed
20f582fe - preprocessing from arrow file to load an HF dataset

Commit

3 years ago

preprocessing from arrow file to load an HF dataset

References

#264 - Preprocessing from arrow file to load an HF dataset

Author

TevenLeScao

TevenLeScao

Parents

Loading