transformers
fix AutoTP in deepspeed could not work for bloom
#22196
Merged

fix AutoTP in deepspeed could not work for bloom #22196

sgugger merged 2 commits into huggingface:main from sywangyi:auto_tp_bloom
sywangyi
sywangyi
sywangyi fix AutoTP in deepspeed could not work for bloom
45348211
sywangyi sywangyi force pushed to 45348211 2 years ago
sywangyi sywangyi changed the title fix AutoTP in deepspeed could not work for bloom (#8) fix AutoTP in deepspeed could not work for bloom 2 years ago
sywangyi
sywangyi
HuggingFaceDocBuilderDev
sgugger
sgugger approved these changes on 2023-03-16
sgugger
sywangyi
sgugger
sywangyi add a method in BloomModel to build ailib
10af2b47
sywangyi
sgugger
sgugger approved these changes on 2023-03-17
sgugger sgugger merged 675d2a5a into main 2 years ago
sywangyi sywangyi deleted the auto_tp_bloom branch 2 years ago
HuggingFaceDocBuilderDev

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone