Megatron-DeepSpeed
d0fcf417 - preprocessing from arrow file to load an HF dataset

Commit

3 years ago

preprocessing from arrow file to load an HF dataset

Author

TevenLeScao

TevenLeScao

Parents

Loading