PR #4180 Allow exporting a view of the KV cache

Allow exporting a view of the KV cache #4180

ggerganov merged 6 commits into ggml-org:kv-cache-opts from KerfuffleV2:4170-export

Allow exporting a view of the KV cache

71fcb7e2

Allow dumping the sequences per cell in common

cb137d8b

ggerganov approved these changes on 2023-11-23

Track max contiguous cells value and position as well

22d0485a

Fix max contiguous empty cells index calculation

7688d720

Fix off by one error in dump_kv_cache_view

bc1c346a

Add doc comments for KV cache view functions

aa21e6db

ggerganov merged 5df7d06c into kv-cache-opts 2 years ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

None yet

Milestone

No milestone