llama.cpp
embedding: free the batch after execution
#7297
Merged

embedding: free the batch after execution #7297

dm4
dm4 embedding: free the batch after execution
518fbc1f
mofosyne mofosyne added bugfix
mofosyne mofosyne added Review Complexity : Low
ggerganov
ggerganov approved these changes on 2024-05-15
ggerganov ggerganov merged ea3b0590 into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone