DeepSpeed
283eda86 - Set tp=1 where MPU is None for bf16 optimizer

Commit

2 years ago

Set tp=1 where MPU is None for bf16 optimizer

References

#5245 - Set tp to 1 when MPU is None for bf16 optimizer

Author

samadejacobs

samadejacobs

Parents

Loading