transformers
a573ac74 - Add the XPU device check for pipeline mode (#28326)

Commit
2 years ago
Add the XPU device check for pipeline mode (#28326) * Add the XPU check for pipeline mode When setting xpu device for pipeline, It needs to use is_torch_xpu_available to load ipex and determine whether the device is available. Signed-off-by: yuanwu <yuan.wu@intel.com> * Don't move model to device when hf_device_map isn't None 1. Don't move model to device when hf_device_map is not None 2. The device string maybe includes the device index, so use 'in'instead of equal Signed-off-by: yuanwu <yuan.wu@intel.com> * Raise the error when xpu is not available Signed-off-by: yuanwu <yuan.wu@intel.com> * Update src/transformers/pipelines/base.py Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> * Update src/transformers/pipelines/base.py Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> * Modify the error message Signed-off-by: yuanwu <yuan.wu@intel.com> * Change message format. Signed-off-by: yuanwu <yuan.wu@intel.com> --------- Signed-off-by: yuanwu <yuan.wu@intel.com> Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
Author
Parents
Loading