llama.cpp
(FOR CI) Xsn/add n support
#50
Open
Overview
Commits
11
Changes
View On GitHub

(FOR CI) Xsn/add n support #50

ngxson wants to merge 11 commits into master from xsn/add_n_support
ngxson
ngxson backend support
15ce574d
ngxson server: support multiple generations from one prompt (OAI "n" option)
0d842cb5
ngxson fix invalid batch
bf33d13b
ngxson format oai
a768a5e8
ngxson clean up
5cc3156f
ngxson disable ctx shift
2a7728f5
ngxson add test
e0660710
ngxson update comments
46f6fd26
ngxson fix style
b65ee647
coderabbitai
github-actions github-actions added examples
github-actions github-actions added python
github-actions github-actions added server
ngxson add n_cmpl to docs [no ci]
6fb3226d
ngxson allowing using both n_cmpl and n
ea7f0669

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
examples python server
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum