llama.cpp
f257fd25 - Add an API example using server.cpp similar to OAI. (#2009)

Commit

2 years ago

Add an API example using server.cpp similar to OAI. (#2009) * add api_like_OAI.py * add evaluated token count to server * add /v1/ endpoints binding

References

Author

jwj7140

Parents