PR #15473 llama : remove KV cache defragmentation logic

llama : remove KV cache defragmentation logic #15473

ggerganov merged 1 commit into master from gg/remove-defrag

ggerganov requested a review from

ngxson 158 days ago

github-actions added script

github-actions added examples

github-actions added python

github-actions added server

Base automatically changed from gg/kv-self-remove-api to master 158 days ago

llama : remove KV cache defragmentation logic

d6588a82

ggerganov force pushed from 89e4e62d to d6588a82 158 days ago

ggerganov merged 9ebebef6 into master 158 days ago

ggerganov deleted the gg/remove-defrag branch 158 days ago

Reviewers

ngxson

Assignees

No one assigned

Labels

script examples python server

Milestone

No milestone