llama.cpp
Make model stateless and context stateful (llama_state)
#1797

Merged

Make model stateless and context stateful (llama_state) #1797

ggerganov merged 10 commits into ggml-org:master from didzis:stateless-model

llama : make model stateless and context stateful

0a30fc99

llama : minor cleanup

22904afa

llama : update internal API declaration

df57fcb9

ggerganov added refactoring

ggerganov approved these changes on 2023-06-17

howard0su commented on 2023-06-18

Apply suggestions from code review

7e14cb90

Missing model memory release

948ce2cf

Sync with upstream

51836999

Fix style

793bcc0b

Add deprecated warning for public API function llama_init_from_file

7bba46ba

Update public API use cases: move away from deprecated llama_init_fro…

69f77628

Deprecate public API function llama_apply_lora_from_file

d7714a8f

ggerganov approved these changes on 2023-06-24

ggerganov merged 527b6fba into master 2 years ago

ggerganov commented on 2023-06-24

Reviewers

ggerganov

howard0su

Assignees

No one assigned

Labels

refactoring

Milestone

No milestone