llama.cpp
4b9afbbe - retrieval : fix memory leak in retrieval query handling (#8955)

Commit

1 year ago

retrieval : fix memory leak in retrieval query handling (#8955) * retrieval * Reuse querybatch to reduce frequent memory allocation * delete unused white space

References

#8955 - Retrieval: Fix Memory Leak in Retrieval Query Handling

Author

gtygo

Parents

37501d9c

llama.cpp 4b9afbbe - retrieval : fix memory leak in retrieval query handling (#8955)

llama.cpp
4b9afbbe - retrieval : fix memory leak in retrieval query handling (#8955)