llama.cpp
server: fix n_cmpl not skipping processing prompt
#18663
Merged

server: fix n_cmpl not skipping processing prompt #18663

ngxson merged 10 commits into ggml-org:master from ngxson:xsn/fix_n_cmpl
ngxson
ngxson server: fix n_cmpl not skipping processing
a9d7bcb7
ngxson ngxson requested a review from ggerganov ggerganov 17 days ago
ngxson ngxson changed the title server: fix n_cmpl not skipping processing server: fix n_cmpl not skipping processing prompt 17 days ago
ggerganov
ngxson fix infinite loop on empty batch
d7c27d49
ngxson
github-actions github-actions added examples
github-actions github-actions added server
ngxson
ggerganov
ggerganov
ngxson
ggerganov Merge branch 'master' into HEAD
59dda88a
ggerganov cont : init child samplers + modify child logic
439c3b50
ggerganov
ggerganov Merge branch 'master' into pr/18663
91fd50be
ggerganov cont : cleanup
f2d988db
ggerganov
ggerganov approved these changes on 2026-01-09
ggerganov cont : improve n_cmpl logic
a4854f03
ngxson
ngxson commented on 2026-01-09
ngxson
ngxson commented on 2026-01-09
ggerganov cont : remove redundant function
9ceb268e
ggerganov cont : reduce parent checks
aef22e7a
ggerganov fix : nullptr task dereference
cc5cafec
ngxson ngxson merged 9ac2693a into master 14 days ago
ggerganov
ngxson
ngxson

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone