PR #26567 server: (router) do not evict busy models

server: (router) do not evict busy models #26567

ngxson merged 1 commit into master from xsn/server_ref_count

ngxson requested a review 46 days ago

github-actions added server

ngxson force pushed from c54fd5d8 to 8a35de8a 46 days ago

ggerganov commented on 2026-08-05

ggerganov force pushed from 8a35de8a to 43f3209c 45 days ago

ggerganov approved these changes on 2026-08-05

ngxson force pushed from 43f3209c to d20a8211 45 days ago

ngxson force pushed from d20a8211 to 9184647b 43 days ago

ServeurpersoCom approved these changes on 2026-08-07

server: (router) do not evict busy models

1621aade

ngxson force pushed from 9184647b to 1621aade 43 days ago

ngxson merged e1470ee6 into master 43 days ago

Reviewers

ServeurpersoCom

ggerganov

Assignees

No one assigned

Labels

server

Milestone

No milestone