Fix incorrect prompt tokenization in speculative example #4025
ggerganov
merged
3 commits into
ggml-org:master
from
AutonomicPerfectionist:fix-speculative-prompt-processing
ggerganov
approved these changes
on 2023-11-17
Support special tokens and not adding BOS to prompt in speculative
c2d00417
KerfuffleV2
requested changes
on 2023-11-18
Adapt to new should_add_bos function
e778ce4a
Ensure tgt and dft have same add_bos setting
9cfc5e21
KerfuffleV2
approved these changes
on 2023-11-18
Login to write a write a comment.
Login via GitHub