llama.cpp
Fix top-p sampling to match the canonical definition
#1953

Merged

Fix top-p sampling to match the canonical definition #1953

ggerganov merged 3 commits into ggml-org:master from alexrenda:fix_top_p_sampling

Fix top-p sampling to match the standard definition (smallest set tha…

1e7755cf

alexrenda marked this pull request as draft 2 years ago

top-p: correct gt to gte

407b77cd

add test for correct top-p behavior

2880f43b

alexrenda marked this pull request as ready for review 2 years ago

KerfuffleV2 requested a review from

ivanstepanovftw 2 years ago

ggerganov approved these changes on 2023-06-24

ggerganov merged b061ba9e into master 2 years ago

Reviewers

ggerganov

ivanstepanovftw

Assignees

No one assigned

Labels

None yet

Milestone

No milestone