llama.cpp
Add an API example using server.cpp similar to OAI.
#2009

Merged

Add an API example using server.cpp similar to OAI. #2009

SlyEcho merged 11 commits into ggml-org:master from OAI_API

add api_like_OAI.py

f41f09a5

SlyEcho commented on 2023-06-27

fix bugs, remove chat format using \n

cc5de812

fix mistakes

e1abf636

change token count method

a4149aa0

fix whitespace, edit README.md

d7435fe3

add newline

b95016c1

fix bugs

377ecf9e

set n_keep to -1

7dcffd7a

add /v1/ endpoints binding

f713dd51

SlyEcho approved these changes on 2023-07-04

fix bug & add truncation return

41f7a500

print json

93e69abe

SlyEcho merged f257fd25 into master 2 years ago

jwj7140 deleted the OAI_API branch 2 years ago

Reviewers

SlyEcho

Assignees

No one assigned

Labels

None yet

Milestone

No milestone