llama.cpp
9e359a4f - server: continue to update other slots on embedding concurrent request (#5699)

Commit
1 year ago
server: continue to update other slots on embedding concurrent request (#5699) * server: #5655 - continue to update other slots on embedding concurrent request. * server: tests: add multi users embeddings as fixed * server: tests: adding OAI compatible embedding concurrent endpoint * server: tests: adding OAI compatible embedding with multiple inputs
Author
Parents
Loading