DeepSpeed
2887349c
- Adding Tutel to MoE layer (#1528)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Hide Comment Changes
Previous Change (CTRL+↑)
Next Change (CTRL+↓)
Expand Context Lines
Collapse Context Lines
Hide Minimap (CTRL+M)
Commit
3 years ago
Adding Tutel to MoE layer (#1528) Co-authored-by: Alex Muzio <alferre@microsoft.com> Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
References
#1528 - Adding Tutel optimizations to MoE layer
Author
alexandremuzio
Parents
cf1f1601
Files
2
deepspeed/moe
layer.py
sharded_moe.py
Loading
sharded_moe.py