llama.cpp
llama : default sampling changes + greedy update
#9897

Merged

llama : default sampling changes + greedy update #9897

ggerganov merged 7 commits into master from gg/llama-remove-softmax

github-actions added testing

github-actions added examples

slaren approved these changes on 2024-10-15

ggerganov force pushed from 60d8af44 to e5150b10 1 year ago

llama : deprecate softmax sampler + fix dist sampler

e31c8790

tests : replace macros with functions

33a69ec7

sampling : change temperature sampler logic

cb75bebc

cont : no need for special "greedy" logic

57fb835e

tests : init prob correctly

cd978508

ggerganov force pushed from baf3d376 to cd978508 1 year ago

ggerganov marked this pull request as ready for review 1 year ago

llama : handle temp <= 0.0 in the temp_ext sampler too

4a5b5870

ggerganov changed the title ~~llama : deprecate softmax sampler + fix dist sampler~~ llama : default sampling changes 1 year ago

ggerganov changed the title ~~llama : default sampling changes~~ llama : default sampling changes + greedy update 1 year ago

cont : avoid extra loop in temperature sampler for sub-zero temp

06159898

ggerganov merged 55e47786 into master 1 year ago

ggerganov deleted the gg/llama-remove-softmax branch 1 year ago

Reviewers

slaren

Assignees

No one assigned

Labels

testing examples

Milestone

No milestone