add the remaining endpoints - SemanticDiff

Commit

113 days ago

add the remaining endpoints

References

#17216 - server: split HTTP into its own interface

#35 - PoC llama-cli using server code

#36 - PoC proxy with stream support

#37 - PoC server with fully functional router, model load/unload (multiple models in parallel)

Author

ngxson

ngxson

Parents

Loading