llama.cpp
server : simplify state machine for slot
#9283
Merged
Overview
Commits
15
Changes
View On GitHub

server : simplify state machine for slot #9283

ngxson merged 15 commits into ggml-org:master from ngxson:xsn/slot_state_machine
ngxson
ngxson server : simplify state machine for slot
2c81cde4
github-actions github-actions added examples
github-actions github-actions added server
ngxson add SLOT_STATE_DONE_PROMPT
446d57d7
ngxson pop_deferred_task
ec882cc1
ngxson add missing notify_one
d3fedaa6
ngxson
ngxson fix passkey test
fbebf650
ngxson metrics : add n_busy_slots_per_decode
69b398ce
github-actions github-actions added python
ngxson
ngxson fix test step
e8e3e725
ngxson Merge branch 'master' into xsn/slot_state_machine
ba0065fc
ngxson add test
852f6548
ngxson ngxson marked this pull request as ready for review 1 year ago
ngxson ngxson requested a review from ggerganov ggerganov 1 year ago
ngxson
ngxson ngxson requested a review from slaren slaren 1 year ago
ggerganov
ngxson
ngxson maybe fix AddressSanitizer?
040fddee
slaren
slaren commented on 2024-09-05
ggerganov
ngxson fix deque ?
2ab3da68
ngxson missing lock
e9313f2e
ngxson
ngxson pop_deferred_task: also notify
dd7e853b
ggerganov
ggerganov approved these changes on 2024-09-06
ngxson Update examples/server/server.cpp
38b14cd3
ngxson Merge branch 'master' into xsn/slot_state_machine
e0fdcda9
ngxson
ngxson ngxson merged 9b2c24c0 into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
examples python server
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum