llama.cpp
Stream save llama context data to file instead of allocating entire buffer upfront
#2488
Merged
Merged
Stream save llama context data to file instead of allocating entire buffer upfront #2488
slaren
merged
13 commits into
ggml-org:master
from
l3utterfly:stream-save
added stream saving context data to file to avoid allocating unnecess…
6c798db0
generalised copying state data to file or buffer
3cebd6e4
added comments explaining how copy_state_data works
87fcdd97
fixed trailing whitespaces
81f347c1
fixed save load state example
98738785
updated save load state to use public function in llama.cpp
1ffa6be7
- restored breakage of the llama_copy_state_data API
7c5b2b57
fixed function declaration order
cffe923e
restored save load state example
30144f76
fixed whitepace
142da8f9
removed unused llama-util.h include
d4a126cd
slaren
commented
on 2023-08-04
slaren
commented
on 2023-08-04
slaren
commented
on 2023-08-04
slaren
commented
on 2023-08-04
slaren
commented
on 2023-08-04
slaren
commented
on 2023-08-04
slaren
approved these changes
on 2023-08-04
Apply suggestions from code review
e74d42df
Apply code review suggestions
d6360ade
Login to write a write a comment.
Login via GitHub