Go
pytorch
7ed76522
- Use ReduceScatter for AllGather.backward only for NCCL backend
Commit
View On
GitHub
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
2 years ago
Use ReduceScatter for AllGather.backward only for NCCL backend
References
bahuang/allgather_fix
Author
SherlockNoMad
Parents
21165570
Loading