llama.cpp
77757a34 - examples : fix draft sampling and rejection handling (#30095)

Commit
12 days ago
examples : fix draft sampling and rejection handling (#30095) * examples : fix draft sampling and rejection handling This commit fixes two issues in the speculative example which are described in detail in the linked issue. Resolves: https://github.com/ggml-org/llama.cpp/issues/29975 * examples : add kv-unified requirement for parallel > 1
Author
Parents
Loading