DeepSpeed
79f64049 - Use dist collectives instead of mpi routines.

Commit

5 years ago

Use dist collectives instead of mpi routines.

References

#593 - NCCL based 1-bit Implementation + Refactor to add communication backends

Author

awan-10

awan-10

Parents

Loading