transformers
make run_generation more generic for other devices
#25133

Merged

Commits

make run_generation more generic for other devices

ji-huazhong committed 3 years ago
use Accelerate to support any device type it supports.

ji-huazhong committed 3 years ago
make style

statelesshz committed 3 years ago
fix error usage of accelerator.prepare_model

statelesshz committed 3 years ago
use `PartialState` to make sure everything is running on the right device

ji-huazhong committed 3 years ago