transformers
make run_generation more generic for other devices
#25133

Merged

make run_generation more generic for other devices #25133

sgugger merged 5 commits into huggingface:main from ji-huazhong:improve-text-generation

make run_generation more generic for other devices

fc08a1b8

sgugger commented on 2023-07-27

ji-huazhong force pushed 3 years ago

sgugger approved these changes on 2023-07-27

use Accelerate to support any device type it supports.

795efd65

ji-huazhong force pushed to 795efd65 3 years ago

make style

ff1256d2

muellerzr commented on 2023-07-27

fix error usage of accelerator.prepare_model

20cf9891

muellerzr commented on 2023-07-27

use `PartialState` to make sure everything is running on the right de…

1ae7ee48

sgugger approved these changes on 2023-07-28

sgugger merged afa96fff into main 3 years ago

ji-huazhong deleted the improve-text-generation branch 2 years ago

Reviewers

sgugger

muellerzr

Assignees

No one assigned

Labels

None yet

Milestone

No milestone