llama.cpp
af0a5b61 - server: fix incorrectly reported token probabilities (#7125)

Commit

1 year ago

server: fix incorrectly reported token probabilities (#7125) * server: normalize token probabilities * fix temperature == 0.0f

References

Author

JohannesGaessler

Parents