llama.cpp
server: continue to update other slots on embedding concurrent request
#5699
Merged
Merged
server: continue to update other slots on embedding concurrent request #5699
phymbert
merged
3 commits into
master
from
hotfix/server-issue-5655-concurrent-embedding-final
server: #5655 - continue to update other slots on embedding concurren…
09b77b4c
ggerganov
approved these changes
on 2024-02-24
ngxson
approved these changes
on 2024-02-24
server: tests: adding OAI compatible embedding concurrent endpoint
466987eb
server: tests: adding OAI compatible embedding with multiple inputs
04f4cbbd
Login to write a write a comment.
Login via GitHub