llama.cpp
server : (refactoring) do not rely on JSON internally
#10643

Merged

server : (refactoring) do not rely on JSON internally #10643

ngxson merged 19 commits into ggml-org:master from ngxson:xsn/refactor_server_struct_type

server : (refactoring) reduce usage of json internally

b7d38eef

github-actions added examples

github-actions added server

ngxson changed the title ~~server : (refactoring) reduce usage of json internally~~ server : (refactoring) do not rely on JSON internally 1 year ago

move all response types to struct

1011a51b

wip [no ci]

0d6485f0

many fixes

d2419b32

github-actions added python

add virtual function

ea1be7f8

fix index

3b41ad53

minor style fix

12610861

add std::move

eaa12887

ngxson marked this pull request as ready for review 1 year ago

ngxson requested a review from

ggerganov 1 year ago

ngxson requested a review from

slaren 1 year ago

refactor handle_completions_generic

cb666718

add virtual functions

8ab173c8

remove server.hpp

1cf769be

clarify server_sent_event RFC specs

2e560f90

ggerganov approved these changes on 2024-12-05

apply review comments

a43e1dc6

fix model_alias and completion_probabilities

fb4b9be6

ngxson commented on 2024-12-05

small clean up

4c3d2580

remove virtual for to_json_oai_compat()

ffc4441b

ngxson commented on 2024-12-05

naming oai_compat --> oaicompat

db66153d

fix unwanted recursive call

dfa59b90

ngxson added breaking change

update docs

25be4ccc

ngxson merged 6c5bc062 into master 1 year ago

Reviewers

ggerganov

slaren

Assignees

No one assigned

Labels

breaking change examples python server

Milestone

No milestone

llama.cpp server : (refactoring) do not rely on JSON internally #10643 Merged

server : (refactoring) do not rely on JSON internally #10643

llama.cpp
server : (refactoring) do not rely on JSON internally
#10643

Merged