DeepSpeed
535a908f - Set tp world size to 1 in ckpt load, if MPU is not provided (#5243)

Commit

1 year ago

Set tp world size to 1 in ckpt load, if MPU is not provided (#5243) If MPU is not provided, set the tp world size to 1 when loading the (universal) ckpt.

References

#5243 - Set tp world size to 1 in ckpt load, if MPU is not provided

Author

samadejacobs

Parents

74910a97

DeepSpeed 535a908f - Set tp world size to 1 in ckpt load, if MPU is not provided (#5243)

DeepSpeed
535a908f - Set tp world size to 1 in ckpt load, if MPU is not provided (#5243)