DeepSpeed
85cc5f9b - Fix error caused by all_reduce call in domino (#6880)

Comment changes are shownComment changes are hidden
Commit
190 days ago
Fix error caused by all_reduce call in domino (#6880) Fix #6851 Initialize communication backend to fix error caused by all_reduce call in the Domino transformer layer. Verified correctness in local test. --------- Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com> Co-authored-by: Logan Adams <114770087+loadams@users.noreply.github.com>
Author
Parents
  • deepspeed/runtime/domino
    • File
      transformer.py