llama.cpp
server : (refactoring) do not rely on JSON internally
#10643

Merged

server : (refactoring) do not rely on JSON internally #10643

ngxson merged 19 commits into ggml-org:master from ngxson:xsn/refactor_server_struct_type

server : (refactoring) reduce usage of json internally

b7d38eef

github-actions added examples

github-actions added server

ngxson changed the title ~~server : (refactoring) reduce usage of json internally~~ server : (refactoring) do not rely on JSON internally 287 days ago

move all response types to struct

1011a51b

wip [no ci]

0d6485f0

many fixes

d2419b32

github-actions added python

add virtual function

ea1be7f8

fix index

3b41ad53

minor style fix

12610861

add std::move

eaa12887

ngxson marked this pull request as ready for review 286 days ago

ngxson requested a review from

ggerganov 286 days ago

ngxson requested a review from

slaren 286 days ago

refactor handle_completions_generic

cb666718

add virtual functions

8ab173c8

remove server.hpp

1cf769be

clarify server_sent_event RFC specs

2e560f90

ggerganov approved these changes on 2024-12-05

apply review comments

a43e1dc6

fix model_alias and completion_probabilities

fb4b9be6

ngxson commented on 2024-12-05

small clean up

4c3d2580

remove virtual for to_json_oai_compat()

ffc4441b

ngxson commented on 2024-12-05

naming oai_compat --> oaicompat

db66153d

fix unwanted recursive call

dfa59b90

ngxson added breaking change

update docs

25be4ccc

ngxson merged 6c5bc062 into master 284 days ago

Reviewers

ggerganov

slaren

Assignees

No one assigned

Labels

breaking change examples python server

Milestone

No milestone

llama.cpp server : (refactoring) do not rely on JSON internally #10643 Merged

server : (refactoring) do not rely on JSON internally #10643

llama.cpp
server : (refactoring) do not rely on JSON internally
#10643

Merged