llama.cpp
server : do not default to multiple slots with speculative decoding
#17017

Merged

server : do not default to multiple slots with speculative decoding #17017

ggerganov merged 2 commits into master from server/fix-draft-slots

server : do not default to multiple slots with speculative decoding

caa4ca7a

ggerganov requested a review from

ngxson 224 days ago

github-actions added examples

github-actions added server

cont : fix

3ce702f6

ggerganov merged 13b339bc into master 224 days ago

ggerganov deleted the server/fix-draft-slots branch 224 days ago

Reviewers

ngxson

Assignees

No one assigned

Labels

examples server

Milestone

No milestone