llama.cpp
(FOR CI) Test/router load unload
#48
Open

(FOR CI) Test/router load unload #48

ngxson wants to merge 5 commits into ngxson:master from ServeurpersoCom:test/router-load-unload
ngxson
ServeurpersoCom llama-server: add router multi-model tests (#17704)
53352d09
coderabbitai
github-actions github-actions added examples
github-actions github-actions added python
github-actions github-actions added server
ServeurpersoCom llama-server: update test models to new HF repos
3905449e
ServeurpersoCom ServeurpersoCom force pushed from 1eabe34d to 3905449e 104 days ago
ngxson add offline
ec7dc2e4
ServeurpersoCom
ServeurpersoCom llama-server: fix router LRU eviction test and add preloading
320bf5d8
ServeurpersoCom llama-server: fix split model download on Windows
583463b4

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone