PR #25649 server : refactor prompt cache state ownership

server : refactor prompt cache state ownership #25649

ggerganov wants to merge 3 commits into master from gg/server-clear-checkpoints

server : clear checkpoints upon prompt clear

80bef387

server : move the prompt state data to the server_prompt_cache

a6fb362e

github-actions added server

server : handle batched slot being cleared

07e604b1

ggerganov marked this pull request as ready for review 59 minutes ago

ggerganov requested a review 59 minutes ago

Reviewers

No reviews

Assignees

No one assigned

Labels

server

Milestone

No milestone