llama.cpp
server : fix context checkpoint eviction on prompts shorter than checkpoint_min_step
#28302
Merged

server : fix context checkpoint eviction on prompts shorter than checkpoint_min_step #28302

masterFoad
masterFoad server : apply checkpoint min-step eviction only when the checkpoint …
89722330
ggml-gh-bot
github-actions github-actions added server
landrewes33
masterFoad masterFoad marked this pull request as ready for review 3 days ago
masterFoad masterFoad requested a review 3 days ago
ggerganov ggerganov assigned ggerganov ggerganov 3 days ago
ggerganov
ggerganov approved these changes on 2026-09-08
ggerganov ggerganov added merge ready
ServeurpersoCom
ServeurpersoCom approved these changes on 2026-09-08
ggerganov ggerganov merged 5d806aa2 into master 1 day ago
axodouble

Login to write a write a comment.

Login via GitHub

Assignees
Labels
Milestone