DeepSpeed
94c7233a
- Refactor autoTP inference for HE (#4040)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Hide Minimap (CTRL+M)
Commit
1 year ago
Refactor autoTP inference for HE (#4040) * Refactor autoTP inference for HE * Formatting * Move redundant functions to autotp * Remove self from loading class * formatting * Some gpt2 autotp path fixes * precommit
References
mosm/llama2
#4040 - Refactor autoTP inference for HE
Author
molly-smith
Parents
e31b4041
Files
2
deepspeed/module_inject
auto_tp.py
replace_module.py
Loading