DeepSpeed
2c63e349 - Enable auto TP policy for llama model (#3170)

Comment changes are shownComment changes are hidden
Commit
2 years ago
Enable auto TP policy for llama model (#3170) * Enable auto TP policy for llama model * Update automatic-tensor-parallelism.md --------- Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com> Co-authored-by: Molly Smith <112220543+molly-smith@users.noreply.github.com>
Author
Parents
  • deepspeed/module_inject
    • File
      auto_tp.py
  • docs/_tutorials
    • File
      automatic-tensor-parallelism.md