DeepSpeed
b528f50e - Fix buffer size for pipeline parallel and communication schedule (#2862)

Commit
2 years ago
Fix buffer size for pipeline parallel and communication schedule (#2862) * fix buffer size for pipeline parallel (#2800) * improve explanation of buffer size for pipeline parallelism Co-authored-by: Jae-Won Chung <jwnchung@umich.edu> * fix format of comment --------- Co-authored-by: Jeff Rasley <jerasley@microsoft.com> Co-authored-by: Jae-Won Chung <jwnchung@umich.edu> Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
Author
Parents
Loading