llama.cpp
server : reuse llama_sample_token common util
#3494
Merged

server : reuse llama_sample_token common util #3494

jhen0409
jhen0409 server : reuse llama_sample_token common function
898816a3
jhen0409 common : use n_probs for temperature sampling
00006da2
ggerganov
ggerganov approved these changes on 2023-10-06
ggerganov ggerganov merged 97af49fa into master 2 years ago
jhen0409 jhen0409 deleted the server-reuse-sample-token branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone