llama.cpp
server : fix checkpoints not being freed when a slot's prompt is cleared
#25647
Closed
Overview
Commits
1
Changes
View On GitHub

server : fix checkpoints not being freed when a slot's prompt is cleared #25647

AlejandroParedesLT wants to merge 1 commit into ggml-org:master from AlejandroParedesLT:fix-checkpoint-leak-25437
AlejandroParedesLT
AlejandroParedesLT AlejandroParedesLT requested a review 3 days ago
AlejandroParedesLT AlejandroParedesLT requested a review from pwilkin pwilkin 3 days ago
AlejandroParedesLT AlejandroParedesLT requested a review from ggerganov ggerganov 3 days ago
github-actions github-actions added testing
github-actions github-actions added server
AlejandroParedesLT AlejandroParedesLT changed the title Prune checkpoints after request for prune prefix is sent server : fix checkpoints not being freed when a slot's prompt is cleared 3 days ago
ggml-gh-bot
AlejandroParedesLT server: fix kvcache checkpoints not being freed after request prefix …
36dff768
AlejandroParedesLT AlejandroParedesLT force pushed from 685331ef to 36dff768 3 days ago
ggerganov ggerganov assigned ggerganov ggerganov 3 days ago
AlejandroParedesLT
ggerganov
ggerganov ggerganov closed this 3 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
Labels
testing server
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum