llama.cpp
7bd8282c - speculative : refactor enabled configs common_speculative_init (#26510)

Commit
30 days ago
speculative : refactor enabled configs common_speculative_init (#26510) This commit contains a suggestion to reduce some code duplication in common_speculative_init when adding the enabled speculative decoding configurations. No tests were added but the existing server tests still passes with this change: ```console $ ./tests.sh unit/test_speculative.py -v -x ```
Author
Parents
Loading