llama.cpp
server : fix speculative decoding with context shift
#10641
Merged

Commits
  • server : fix speculative decoding with context shift
    ggerganov committed 1 year ago
  • server : take into account speculative limits
    ggerganov committed 1 year ago
  • server : add tests
    ggerganov committed 1 year ago
Loading