llama.cpp
a82dbbfb - decouple server_models from server_routes

Commit

128 days ago

decouple server_models from server_routes

References

#39 - (staging PR) server: add model management and proxy

#17470 - server: introduce API for serving / loading / unloading multiple models

Author

ngxson

ngxson

Parents

Loading