accelerate
d6d3e03c - Use torch.xpu.mem_get_info for XPU (#3275)

Commit
1 year ago
Use torch.xpu.mem_get_info for XPU (#3275) torch.xpu.mem_get_info API is available starting from PyTorch 2.6 (and in nightly 2.6.0.dev20241206+xpu or later). To work properly this method requires PyTorch built with the SYCL runtime which supports API to query device memory stats. If not available, exception will be raised. Requires: https://github.com/pytorch/pytorch/pull/141230 Fixes: #2929 Fixes: https://github.com/huggingface/transformers/issues/31922 Signed-off-by: Dmitry Rogozhkin <dmitry.v.rogozhkin@intel.com>
Author
Parents
Loading