llama.cpp
ggml, server: add ggml_backend_dev_reset() for sleep mode
#25271

Open

Commits

add ggml_backend_dev_reset() for sleep mode

ngxson committed 43 days ago
add hipDeviceReset()

ngxson committed 43 days ago
unimpl for other backend

ngxson committed 43 days ago
use CUDA_CHECK

ngxson committed 43 days ago
nits

ngxson committed 43 days ago
musaDeviceReset

ngxson committed 43 days ago

Loading