llama.cpp
b6e7f9b0 - llama : add api for getting/setting the complete state: rng, logits, embedding and kv_cache (#1105)

Commit
2 years ago
llama : add api for getting/setting the complete state: rng, logits, embedding and kv_cache (#1105) * reserve correct size for logits * add functions to get and set the whole llama state: including rng, logits, embedding and kv_cache * remove unused variables * remove trailing whitespace * fix comment
Author
Parents
Loading