DeepSpeed
782642d7 - Set tp=1 where MPU is None for bf16 optimizer

Commit

1 year ago

Set tp=1 where MPU is None for bf16 optimizer

References

#5245 - Set tp to 1 when MPU is None for bf16 optimizer

Author

samadejacobs

samadejacobs

Parents

Loading