PR #13706 kv-cache : rework kv_cell

kv-cache : rework kv_cell #13706

ggerganov merged 7 commits into master from gg/kv-cache-simplify-part2

ggerganov requested a review from

slaren 141 days ago

slaren commented on 2025-05-22

ggerganov force pushed from 0a8cdc3a to eda2e136 140 days ago

slaren approved these changes on 2025-05-23

kv-cache : rework kv_cell

be9558e3

kv-cells : use "shift" instead of "delta" consistently

71be7e50

llama : add llama_max_parallel_sequences()

7b3f12a8

kv-cells : update comments [no ci]

6221dd29

context : fail upon construction if sequences exceed max value

43b40d3f

kv-cells : get_pos() -> pos_get() + comments

f71e737a

ggerganov force pushed from 1ec785c7 to 0dc48042 139 days ago

kv-cells : fix tracking of "used" cells

dd394a69

ggerganov force pushed from 0dc48042 to dd394a69 139 days ago

ggerganov merged de2ef53a into master 138 days ago

ggerganov deleted the gg/kv-cache-simplify-part2 branch 138 days ago

Reviewers

slaren

Assignees

No one assigned

Labels

None yet

Milestone

No milestone