llama.cpp
server: improve slots scheduling for n_cmpl
#18789
Merged

server: improve slots scheduling for n_cmpl #18789

ngxson
ngxson server : make sure children tasks are scheduled to launch with parent
b55964a1
ngxson fix
e32545f1
ngxson ngxson requested a review from ggerganov ggerganov 198 days ago
ngxson add comment pointing to this PR
821e329e
ngxson fix
25702ba8
ngxson clean up
9481b9d2
github-actions github-actions added examples
github-actions github-actions added python
github-actions github-actions added server
ggerganov
ngxson more debug messages
f0349e40
ngxson add pop_deferred_task with specific ID version
da6e2bac
ggerganov
ngxson improve the logic
d6b0d239
ngxson
ngxson
ggerganov
ggerganov commented on 2026-01-13
ggerganov
ggerganov commented on 2026-01-13
ngxson simple approach
ba86ad96
ggerganov
ggerganov approved these changes on 2026-01-14
ngxson no double move
79c1967e
ngxson Merge branch 'master' into xsn/n_cmpl_sync_barrier
d5505b16
ngxson
ngxson correct return type of launch_slots_with_parent_task
8b5474a0
ngxson Merge branch 'master' into xsn/n_cmpl_sync_barrier
64b48eb4
ngxson ngxson merged a04c2b06 into master 195 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone