llama.cpp
server: add --sleep-mode rst, reset the proc while keeping metrics
#27418

Open

server: add --sleep-mode rst, reset the proc while keeping metrics #27418

ngxson wants to merge 7 commits into master from xsn/server_sleep_proc

add cache serializer

5f9b61d6

server: add --sleep-mode rst

437b415f

add docs

4c4a0ba8

ngxson force pushed to 4c4a0ba8 34 days ago

ngxson changed the title ~~Xsn/server sleep proc~~ server: add --sleep-mode rst 34 days ago

ngxson changed the title ~~server: add --sleep-mode rst~~ server: add --sleep-mode rst, reset the proc but keep metrics 34 days ago

ngxson changed the title ~~server: add --sleep-mode rst, reset the proc but keep metrics~~ server: add --sleep-mode rst, reset the proc while keeping metrics 34 days ago

move llama_backend_init to load_model

a138f8d6

github-actions added documentation

github-actions added server

fix common_params_print_info

fc9969c7

fix

0d9a89c7

nits

e12b6c2c

ngxson marked this pull request as ready for review 34 days ago

ngxson requested a review 34 days ago

ngxson marked this pull request as draft 34 days ago

Reviewers

No reviews

Assignees

No one assigned

Labels

documentation server

Milestone

No milestone

llama.cpp server: add --sleep-mode rst, reset the proc while keeping metrics #27418 Open

server: add --sleep-mode rst, reset the proc while keeping metrics #27418

llama.cpp
server: add --sleep-mode rst, reset the proc while keeping metrics
#27418

Open