llama.cpp
0f7fada5 - cuda: reset cuda context after reading memory size (#23935)

Commit
1 day ago
cuda: reset cuda context after reading memory size (#23935) * cuda: reset device in get_memory function if no backend is active * also count device and host buffers * exclude hip and musa from counting and device reset * use device mutex instead of atomic * undo backend_free function move
Author
Parents
Loading