llama.cpp
e1470ee6 - server: (router) do not evict busy models (#26567)

Commit

3 days ago

server: (router) do not evict busy models (#26567)

References

#26567 - server: (router) do not evict busy models

Author

ngxson

ngxson

Parents

Loading