llama.cpp
Work around for recalculating logits in cached prompts (Fixes #1585)
#1609
Merged
Merged
Work around for recalculating logits in cached prompts (Fixes #1585) #1609
DannyDaemonic
merged
3 commits into
ggml-org:master
from
DannyDaemonic:cached-logits-bandaid
Work around for recalculating logits in cached prompts
573b690e
github-actions
commented
on 2023-05-27
n_session_consumed should just be size_t, but the cache code casts to…
6d47258e
KerfuffleV2
commented
on 2023-05-27
Merge remote-tracking branch 'upstream/master' into cached-logits-ban…
44c83c6e
SlyEcho
approved these changes
on 2023-05-29
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub