llama.cpp
97895129 - ggml-cuda: flush legacy pool on OOM and retry (#22155)

Commit
78 days ago
ggml-cuda: flush legacy pool on OOM and retry (#22155) * ggml-cuda: flush legacy pool on OOM and retry Signed-off-by: 梁厚宏 <2695316095@qq.com> * Address review comments: add explicit sync, update destructor, clean up MUSA macros Signed-off-by: 梁厚宏 <2695316095@qq.com> --------- Signed-off-by: 梁厚宏 <2695316095@qq.com>
Author
Parents
Loading