llama.cpp
Some improvements to loading the session with --prompt-cache
#1550

Merged

Some improvements to loading the session with --prompt-cache #1550

KerfuffleV2 merged 5 commits into ggml-org:master from KerfuffleV2:feat-session_loading_improvements

github-actions commented on 2023-05-21

KerfuffleV2 force pushed 3 years ago

ejones dismissed these changes on 2023-05-23

DannyDaemonic commented on 2023-05-23

KerfuffleV2 requested a review from

DannyDaemonic 3 years ago

ejones dismissed their stale review 3 years ago

I'll let @DannyDaemonic take this

Some improvements to loading the session with --prompt-cache

de5bf5bf

Apply clang suggestions.

2d799289

Use existing session behavior when in instruct or interact first mode

e1ec489e

Use the initial value of params.seed to determine if user supplied seed

76c73987

Always set RNG seed when restoring cached prompt in main example.

156d70b8

KerfuffleV2 force pushed to 156d70b8 3 years ago

DannyDaemonic commented on 2023-05-25

DannyDaemonic approved these changes on 2023-05-26

KerfuffleV2 merged 66874d4f into master 3 years ago

KerfuffleV2 deleted the feat-session_loading_improvements branch 3 years ago

Reviewers

DannyDaemonic

github-actions

ejones

Assignees

No one assigned

Labels

None yet

Milestone

No milestone