server: add option to output probabilities for completion #1962
SlyEcho
merged
27 commits into
ggml-org:master
from
WangHaoranRobin:master
server: add option to output probabilities for completion
ba210e4b
Merge pull request #1 from WangHaoranRobin/robin_fork_master
8004e673
SlyEcho
commented
on 2023-06-22
server: fix comment about max n_probs
ccf254bd
Merge pull request #2 from WangHaoranRobin/robin_fork_master
926664c2
SlyEcho
commented
on 2023-06-22
server: fix issue when handling probability output for incomplete tok…
cf761952
Merge pull request #3 from WangHaoranRobin/robin_fork_master
bdb710ef
server: fix some beginner mistakes
7b93b248
Merge pull request #4 from WangHaoranRobin/robin_fork_master
7cd8fc20
Merge branch 'ggerganov:master' into master
6c76c311
server: remove trailling white space
02c96a4c
Merge pull request #5 from WangHaoranRobin/robin_fork_master
7f7046ea
Merge branch 'ggerganov:master' into master
23b516b0
Merge branch 'ggerganov:master' into master
af058cf8
SlyEcho
commented
on 2023-06-25
SlyEcho
commented
on 2023-06-25
server: remove n_probs upper limit of 5
e815b695
Merge pull request #6 from WangHaoranRobin/robin_fork_master
bd6550bd
SlyEcho
requested changes
on 2023-06-25
server: handle probs output when temp=0; handle final response probs …
c9e6642c
Merge branch 'master' into robin_fork_master
13f5d697
Merge pull request #7 from WangHaoranRobin/robin_fork_master
77edee7d
Merge branch 'ggerganov:master' into master
b5c5c8e2
SlyEcho
approved these changes
on 2023-06-26
ghost
commented
on 2023-06-27
Merge branch 'ggerganov:master' into master
c7f7f136
server: fix llama_sample_top_k order
bc88fece
Merge pull request #8 from WangHaoranRobin/robin_fork_master
58828c20
Merge branch 'ggerganov:master' into master
1d22550f
ggerganov
commented
on 2023-07-01
ggerganov
approved these changes
on 2023-07-01
Merge branch 'ggerganov:master' into master
ad807731
examples/common.h: put all bool variables in gpt_params together
1a70a803
examples/common.h: put all bool variables in gpt_params together
71f82967
Merge pull request #9 from WangHaoranRobin/robin_fork_master
cc3c86f6
Login to write a write a comment.
Login via GitHub