llama.cpp
server : disable speculative decoding for SWA models
#13970
Merged

server : disable speculative decoding for SWA models #13970

ggerganov merged 2 commits into master from gg/server-spec-swa-clear
ggerganov
ggerganov server : use swa-full fo draft context
b4f7dcf3
github-actions github-actions added examples
github-actions github-actions added server
ggerganov server : disable speculative decoding for SWA models
272df3f9
ggerganov ggerganov changed the title server : use swa-full fo draft context server : disable speculative decoding for SWA models 1 year ago
ggerganov ggerganov marked this pull request as ready for review 1 year ago
ggerganov ggerganov requested a review from ngxson ngxson 1 year ago
ggerganov ggerganov merged 36375762 into master 1 year ago
ggerganov ggerganov deleted the gg/server-spec-swa-clear branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone