PR #22196 fix AutoTP in deepspeed could not work for bloom

fix AutoTP in deepspeed could not work for bloom #22196

sgugger merged 2 commits into huggingface:main from sywangyi:auto_tp_bloom

fix AutoTP in deepspeed could not work for bloom

45348211

sywangyi force pushed to 45348211 2 years ago

sywangyi changed the title ~~fix AutoTP in deepspeed could not work for bloom (#8)~~ fix AutoTP in deepspeed could not work for bloom 2 years ago

sgugger approved these changes on 2023-03-16

add a method in BloomModel to build ailib

10af2b47

sgugger approved these changes on 2023-03-17

sgugger merged 675d2a5a into main 2 years ago

sywangyi deleted the auto_tp_bloom branch 2 years ago

Reviewers

sgugger

Assignees

No one assigned

Labels

None yet

Milestone

No milestone