llama.cpp
d5fabe36 - CANN: Optimize ggml_cann_set_device (#15935)

Commit
106 days ago
CANN: Optimize ggml_cann_set_device (#15935) * CANN: Fix ggml_cann_set_device to avoid redundant device switches - Added a check to skip aclrtSetDevice if the current device is already set. - Prevents unnecessary context switches while keeping thread/device consistency. * CANN: add device default id
Author
Parents
Loading