PR #9274 server : refactor multitask handling

server : refactor multitask handling #9274

ngxson merged 10 commits into ggml-org:master from ngxson:xsn/refactor_server_multitask

server : remove multitask from server_task

012d8d8c

refactor completions handler

4a5dbd85

fix embeddings

9f56c176

use res_ok everywhere

588b4bba

small change for handle_slots_action

83249aae

use unordered_set everywhere

24329aac

ngxson requested a review from

ggerganov 1 year ago

github-actions added examples

github-actions added server

(try) fix test

31a2d4a4

github-actions added python

ngxson removed python

no more "mutable" lambda

fa221065

github-actions added python

ggerganov approved these changes on 2024-09-02

Apply suggestions from code review

27f2c14a

use deque

86caa353

ngxson merged 6e7d133a into master 1 year ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

examples python server

Milestone

No milestone