server: fix n_cmpl not skipping processing prompt #18663
server: fix n_cmpl not skipping processing
a9d7bcb7
ngxson
changed the title server: fix n_cmpl not skipping processing server: fix n_cmpl not skipping processing prompt 17 days ago
fix infinite loop on empty batch
d7c27d49
Merge branch 'master' into HEAD
59dda88a
cont : init child samplers + modify child logic
439c3b50
Merge branch 'master' into pr/18663
91fd50be
cont : cleanup
f2d988db
ggerganov
approved these changes
on 2026-01-09
cont : improve n_cmpl logic
a4854f03
ngxson
commented
on 2026-01-09
ngxson
commented
on 2026-01-09
cont : remove redundant function
9ceb268e
cont : reduce parent checks
aef22e7a
fix : nullptr task dereference
cc5cafec
ngxson
merged
9ac2693a
into master 14 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub