DeepSpeed
add sharded checkpoint loading for AutoTP path to reduce the peak mem…
#3102
Merged
Merged