llama.cpp
40a34fe8
- speculative : fix prompt tokenization in speculative example (#4025)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
speculative : fix prompt tokenization in speculative example (#4025) * Support special tokens and not adding BOS to prompt in speculative * Adapt to new should_add_bos function * Ensure tgt and dft have same add_bos setting
References
#4025 - Fix incorrect prompt tokenization in speculative example
Author
AutonomicPerfectionist
Parents
dae06c06
Loading