llama.cpp
server: fix reported top tokens for temperature 0
#7203

Merged

server: fix reported top tokens for temperature 0 #7203

JohannesGaessler merged 1 commit into ggml-org:master from JohannesGaessler:sampling-fix-n_cons

server: fix reported top tokens for temperature 0

fe47a6dc

mofosyne added bugfix

mofosyne added Review Complexity : Low

mofosyne added server

ggerganov approved these changes on 2024-05-11

JohannesGaessler merged 5ae3426b into master 1 year ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

bugfix Review Complexity : Low server

Milestone

No milestone