llama.cpp
d7d2e6a0 - server: add option to output probabilities for completion (#1962)

Commit
2 years ago
server: add option to output probabilities for completion (#1962) * server: add option to output probabilities for completion * server: fix issue when handling probability output for incomplete tokens for multibyte character generation * server: fix llama_sample_top_k order * examples/common.h: put all bool variables in gpt_params together
Parents
Loading