llama : minimize size used for state save/load #4820
ggerganov
merged
7 commits into
ggml-org:master
from
dfriehs:min-state-size
examples : save-load-state: save only required state
aee95df8
llama : only reserve n_vocab * n_batch at most for logits
0093dea9
llama : always reserve n_vocab * n_batch for logits
b9c60dec
llama : only save and restore used logits
5ee58147
llama : use ostringstream and istringstream for save and load
e872af8d
llama : serialize rng into minimum amount of space required
69d44e3e
llama : break session version due to serialization changes
06e3b4f5
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub