DeepSpeed
add llama2 autoTP support in replace_module
#4022
Merged

add llama2 autoTP support in replace_module #4022

dc3671
add llama2 autoTP support in replace_module
192b323d
dc3671 dc3671 requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 2 years ago
dc3671 dc3671 requested a review from jeffra jeffra 2 years ago
dc3671 dc3671 requested a review from mrwyattii mrwyattii 2 years ago
dc3671 dc3671 requested a review from awan-10 awan-10 2 years ago
dc3671 dc3671 requested a review from cmikeh2 cmikeh2 2 years ago
dc3671 dc3671 requested a review from arashb arashb 2 years ago
mrwyattii
mrwyattii approved these changes on 2023-07-24
mrwyattii mrwyattii merged f3943cf9 into master 2 years ago
dc3671 dc3671 deleted the fix-llama2-autotp branch 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone