Megatron-DeepSpeed

fa9f54c9 - Add step to download dataset before running the preprocess_data_dist test (#81)

Add step to download dataset before running the preprocess_data_dist test (#81) * tests: add step to predownload dataset for preprocess_data_dist * load dataset directly in pytest * cache load_dataset result