llama.cpp
server : do not return error when running out of context (with ctx shift disabled)
#13577
Merged

server : do not return error when running out of context (with ctx shift disabled) #13577

ngxson
ngxson server : do not return error out of context (with ctx shift disabled)
76b54dfa
ngxson ngxson requested a review from ggerganov ggerganov 1 year ago
github-actions github-actions added examples
github-actions github-actions added python
github-actions github-actions added server
esrakorkmz
esrakorkmz approved these changes on 2025-05-15
ggerganov
ggerganov approved these changes on 2025-05-16
ngxson ngxson merged 6aa892ec into master 364 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone