llama.cpp
server : fix speculative decoding with context shift
#10641
Merged
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
3
Changes
View On
GitHub
Commits
server : fix speculative decoding with context shift
ggerganov
committed
1 year ago
server : take into account speculative limits
ggerganov
committed
1 year ago
server : add tests
ggerganov
committed
1 year ago
Loading