llama.cpp
server : add more clean up when cancel_tasks is called
#11340

Merged

server : add more clean up when cancel_tasks is called #11340

ngxson merged 4 commits into ggml-org:master from ngxson:xsn/server_tighten_cancel

server : add more clean up when cancel_tasks is called

f4dab52a

ngxson requested a review from

ggerganov 287 days ago

github-actions added examples

github-actions added server

ggerganov dismissed these changes on 2025-01-22

ggerganov dismissed their stale review 286 days ago

`llama-server` deadlocks in certain cases

ngxson commented on 2025-01-22

fix recv_with_timeout

08296ec7

std::remove_if

b9e51710

fix std::remove_if

0244e797

ngxson requested a review from

ggerganov 286 days ago

ggerganov approved these changes on 2025-01-23

ngxson merged 58456616 into master 285 days ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

examples server

Milestone

No milestone