llama.cpp
Fix issue where interactive mode crashes when input exceeds ctx size
#1789
Merged
Merged
Fix issue where interactive mode crashes when input exceeds ctx size #1789
KerfuffleV2
merged
3 commits into
ggml-org:master
from
KerfuffleV2:fix-interactive-ctx-overflow
Fix issue where interactive mode crashes when input exceeds ctx size
910fb8b6
Use n_ctx - 4 for max_embd_size to match existing behavior
f5a790f7
slaren
commented
on 2023-06-11
slaren
commented
on 2023-06-11
slaren
approved these changes
on 2023-06-11
Add a comment clarifying where n_ctx - 4 came from
855ede74
Login to write a write a comment.
Login via GitHub