llama.cpp
llama : add option for greedy sampling with probs
#3813

Merged

llama : add option for greedy sampling with probs #3813

ggerganov merged 3 commits into master from sampling-greedy-with-probs

ggerganov requested a review from

KerfuffleV2 2 years ago

llama : add option for greedy sampling with probs

4aa1fb0d

ggerganov force pushed from e274fe3a to 4aa1fb0d 2 years ago

KerfuffleV2 commented on 2023-10-27

llama : add comment about llama_sample_token_greedy() missing probs

c86cca80

sampling : temp == 0.0 -> no probs, temp < 0.0 -> probs

bbfc62ac

KerfuffleV2 approved these changes on 2023-10-28

ggerganov merged ee1a0ec9 into master 2 years ago

Reviewers

KerfuffleV2

Assignees

No one assigned

Labels

None yet

Milestone

No milestone