PR #4232 Add single-client multi-prompt support

Add single-client multi-prompt support #4232

ggerganov merged 11 commits into ggml-org:master from ziedbha:ziadb/multiprompt

* add multiprompt support

09562678

* cleanup

ff67c764

* more cleanup

5906fb44

ziedbha commented on 2023-11-27

* remove atomicity of id_gen, and change lock_guard to unique_lock on…

e2ee3776

ggerganov commented on 2023-11-29

* remove all references to mutex_multitasks

38ce5d02

ziedbha requested a review from

ggerganov 2 years ago

ziedbha requested a review from

cebtenzzre 2 years ago

cebtenzzre commented on 2023-11-29

Update examples/server/server.cpp

09da4b14

Update examples/server/server.cpp

0e1a5aa5

Update examples/server/server.cpp

14785e11

Update examples/server/server.cpp

3b371e10

cebtenzzre commented on 2023-11-30

Green-Sky commented on 2023-11-30

ggerganov approved these changes on 2023-11-30

* change to set

0f175a60

* merge with base

73df0c43

ggerganov merged f43f0936 into master 2 years ago

Reviewers

ggerganov

Green-Sky

cebtenzzre

Assignees

No one assigned

Labels

None yet

Milestone

No milestone