llama.cpp
1621aade - server: (router) do not evict busy models

Commit

4 days ago

server: (router) do not evict busy models

References

xsn/server_ref_count

#26567 - server: (router) do not evict busy models

Author

ngxson

ngxson

Committer

ngxson

ngxson

Parents

Loading