llama.cpp
Retrieval: Fix Memory Leak in Retrieval Query Handling
#8955

Merged

Retrieval: Fix Memory Leak in Retrieval Query Handling #8955

ggerganov merged 3 commits into ggml-org:master from gtygo:master

retrieval

fe6dc611

ggerganov commented on 2024-08-09

Reuse querybatch to reduce frequent memory allocation

88105b7f

gtygo requested a review from

ggerganov 1 year ago

ggerganov approved these changes on 2024-08-09

github-actions added examples

mofosyne added Review Complexity : Low

mofosyne added bugfix

delete unused white space

804ddd70

ggerganov merged 4b9afbbe into master 1 year ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

examples bugfix Review Complexity : Low

Milestone

No milestone