llama.cpp
Feature: Added api for getting/setting the complete state: rng, logits, embedding and kv_cache
#1105

Merged

Feature: Added api for getting/setting the complete state: rng, logits, embedding and kv_cache #1105

ggerganov merged 5 commits into ggml-org:master from xaedes:state_persistence

reserve correct size for logits

8ed3c3fe

add functions to get and set the whole llama state:

8288b367

remove unused variables

9d26580b

remove trailing whitespace

1c51e1f3

xaedes force pushed from cab1fe07 to 1c51e1f3 2 years ago

fix comment

456aedc4

ggerganov approved these changes on 2023-04-22

ggerganov merged b6e7f9b0 into master 2 years ago

ggerganov commented on 2023-04-22

Reviewers

ggerganov

Assignees

No one assigned

Labels

None yet

Milestone

No milestone