llama.cpp
Feature: Added api for getting/setting the kv_cache
#685

Merged

Feature: Added api for getting/setting the kv_cache #685

prusnak merged 6 commits into ggml-org:master from chrfalch:feature/get-set-kv-cache

Added api for retrieving and setting the kv cache

14804b79

prusnak requested changes on 2023-04-01

Update llama.cpp

a0c895c0

Update llama.cpp

f411251b

Update llama.h

17f463a0

Update llama.h

a463fb76

chrfalch requested a review from

prusnak 3 years ago

ggerganov approved these changes on 2023-04-02

fix whitespace

4912f9d5

prusnak approved these changes on 2023-04-02

prusnak merged e986f948 into master 3 years ago

Reviewers

ggerganov

prusnak

Assignees

No one assigned

Labels

None yet

Milestone

No milestone