llama.cpp
45b2fe19 - server: split HTTP into its own interface

Commit

41 days ago

server: split HTTP into its own interface

References

#17216 - server: split HTTP into its own interface

#35 - PoC llama-cli using server code

#36 - PoC proxy with stream support

#37 - PoC server with fully functional router, model load/unload (multiple models in parallel)

Author

ngxson

ngxson

Committer

ngxson

ngxson

Parents

Loading