llama.cpp
server : do context shift only while generating
#17000

Merged

server : do context shift only while generating #17000

ggerganov merged 1 commit into master from gg/server-fix-ctx-shift-check

server : do context shift only while generating

7e3667f0

ggerganov requested a review from

ngxson 134 days ago

github-actions added examples

github-actions added server

ggerganov merged 66d8eccd into master 133 days ago

ggerganov deleted the gg/server-fix-ctx-shift-check branch 133 days ago

Reviewers

ngxson

Assignees

No one assigned

Labels

examples server

Milestone

No milestone