jax
a0f8a4aa
- [Pallas:MGPU] Add an all-reduce mode to the reduce-scatter kernel
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
149 days ago
[Pallas:MGPU] Add an all-reduce mode to the reduce-scatter kernel The same strategy we used before (ld_reduce) works, we just need to issue more instructions. PiperOrigin-RevId: 819267594
References
#32571 - [Pallas:MGPU] Add an all-reduce mode to the reduce-scatter kernel
Author
apaszke
Committer
Google-ML-Automation
Parents
4b5d4143
Loading