DeepSpeed
b75647c4 - Set tp world size to 1 in ckpt load, if MPU is not provided

Commit

1 year ago

Set tp world size to 1 in ckpt load, if MPU is not provided

References

#5243 - Set tp world size to 1 in ckpt load, if MPU is not provided

#5245 - Set tp to 1 when MPU is None for bf16 optimizer

Author

samadejacobs

samadejacobs

Parents

Loading