PR #3494 server : reuse llama_sample_token common util

Commits

server : reuse llama_sample_token common function

jhen0409 committed 2 years ago
common : use n_probs for temperature sampling

jhen0409 committed 2 years ago

llama.cpp server : reuse llama_sample_token common util #3494 Merged