DeepSpeed
9f17087f
- Save the model parallel group at inference engine statically (#1411)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Hide Minimap (CTRL+M)
Commit
3 years ago
Save the model parallel group at inference engine statically (#1411) Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
References
#1411 - Fix inference MP group initialization at consequent inference calls
Author
RezaYazdaniAminabadi
Parents
56124621
Files
1
deepspeed/inference
engine.py
Loading