DeepSpeed
94c7233a - Refactor autoTP inference for HE (#4040)

Comment changes are shownComment changes are hidden
Commit
1 year ago
Refactor autoTP inference for HE (#4040) * Refactor autoTP inference for HE * Formatting * Move redundant functions to autotp * Remove self from loading class * formatting * Some gpt2 autotp path fixes * precommit
Author
Parents
  • deepspeed/module_inject
    • File
      auto_tp.py
    • File
      replace_module.py