llama.cpp
llama: fix "Context size has been exceeded" with n_cmpl > 1
#32364
Open

llama: fix "Context size has been exceeded" with n_cmpl > 1 #32364

ngxson wants to merge 1 commit into master from xsn/server_find_slot_fix
ngxson
ngxson llama: fix "Context size has been exceeded" with n_cmpl > 1
9d21a65c
ngxson ngxson requested a review from ggerganov ggerganov 1 day ago
ngxson ngxson requested a review 1 day ago
ngxson
github-actions github-actions added testing

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone