llama.cpp
40a34fe8 - speculative : fix prompt tokenization in speculative example (#4025)

Commit
1 year ago
speculative : fix prompt tokenization in speculative example (#4025) * Support special tokens and not adding BOS to prompt in speculative * Adapt to new should_add_bos function * Ensure tgt and dft have same add_bos setting
Parents
Loading