llama.cpp
Allocate all temporary ggml_tensor_extra_gpu from a fixed-size buffer
#2220
Merged
Merged
Allocate all temporary ggml_tensor_extra_gpu from a fixed-size buffer #2220
ggerganov
merged
1 commit into
ggml-org:master
from
bullno1:offload-leak-2
Login to write a write a comment.
Login via GitHub