llama.cpp
server : fix parallel speculative decoding
#10513
Merged

server : fix parallel speculative decoding #10513

ggerganov merged 1 commit into master from gg/speculative-fix-parallel
ggerganov
ggerganov server : fix parallel speculative decoding
f51e98ff
github-actions github-actions added examples
github-actions github-actions added server
ggerganov ggerganov merged 84e1c33c into master 1 year ago
ggerganov ggerganov deleted the gg/speculative-fix-parallel branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone