llama.cpp
e216aa04
- llama : only copy used KV cache in get / set state (#1272)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
llama : only copy used KV cache in get / set state (#1272) * llama : only copy used KV cache in get / set state * switch to ggml for copying k, v * avoid designated initializers
References
#1272 - llama : only copy used KV cache in get / set state
Author
ejones
Parents
2485d7a4
Loading