fix comm group for allreduce - SemanticDiff

Commit

2 years ago

fix comm group for allreduce

References

#4530 - Fix the sequence-parallelism for the dense model architecture

Author

Masahiro Tanaka

Parents

Loading