llama.cpp
Allow exporting a view of the KV cache
#4180
Merged

Allow exporting a view of the KV cache #4180

KerfuffleV2
KerfuffleV2 Allow exporting a view of the KV cache
71fcb7e2
KerfuffleV2 Allow dumping the sequences per cell in common
cb137d8b
KerfuffleV2
WeirdConstructor
ggerganov
ggerganov approved these changes on 2023-11-23
KerfuffleV2 Track max contiguous cells value and position as well
22d0485a
KerfuffleV2
WeirdConstructor
KerfuffleV2 Fix max contiguous empty cells index calculation
7688d720
KerfuffleV2 Fix off by one error in dump_kv_cache_view
bc1c346a
KerfuffleV2 Add doc comments for KV cache view functions
aa21e6db
KerfuffleV2
ggerganov
KerfuffleV2
ggerganov
ggerganov ggerganov merged 5df7d06c into kv-cache-opts 2 years ago
KerfuffleV2
ggerganov

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone