llama.cpp
llama : only copy used KV cache in get / set state
#1272

Merged

llama : only copy used KV cache in get / set state #1272

ejones merged 3 commits into ggml-org:master from ejones:master

ejones requested a review from

ggerganov 2 years ago

SlyEcho commented on 2023-05-02

ggerganov approved these changes on 2023-05-02

llama : only copy used KV cache in get / set state

970547e7

switch to ggml for copying k, v

0bf20fe5

ejones force pushed from a4e55799 to 0bf20fe5 2 years ago

avoid designated initializers

458df741

ejones merged e216aa04 into master 2 years ago

Reviewers

ggerganov

SlyEcho

Assignees

No one assigned

Labels

None yet

Milestone

No milestone