llama.cpp
server : fix context checkpoint eviction on prompts shorter than checkpoint_min_step
#28302
Open
Open
server : fix context checkpoint eviction on prompts shorter than checkpoint_min_step #28302
masterFoad
wants to merge
1 commit into
ggml-org:master
from
masterFoad:server-ckpt-eviction-pr
server : apply checkpoint min-step eviction only when the checkpoint …
89722330
Reviewers
No reviews
Assignees
No one assigned
Labels
server
Milestone
No milestone
Login to write a write a comment.
Login via GitHub