llama.cpp
(FOR CI) Xsn/server improve spec
#51
Open

(FOR CI) Xsn/server improve spec #51

ngxson wants to merge 9 commits into master from xsn/server_improve_spec
ngxson
ngxson server: improve speed of speculative decoding
f2f08f84
ngxson fix small draft case
cac8d7b2
coderabbitai
github-actions github-actions added examples
github-actions github-actions added server
ngxson add link to the PR
398ae8db
ggerganov server : fix generation time measurement
084cec95
ggerganov server : fix draft acceptance logs (add SRV_CNT, SLT_CNT macros)
f74d1ee9
ggerganov server : add comment
75be6ba0
ngxson Merge branch 'master' into xsn/server_improve_spec
ba5c0b42
ngxson Merge branch 'master' into xsn/server_improve_spec
afe25301
ngxson add PR to docs
0a63bd80

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone