llama.cpp
sampling : refactor init to use llama_sampling_params
#3696

Merged

sampling : refactor init to use llama_sampling_params #3696

ggerganov merged 6 commits into master from sampling-refactor

sampling : refactor init to use llama_sampling_params

cd1e9378

llama : combine repetition, frequency and presence penalties in 1 call

6e658765

examples : remove embd-input and gptneox-wip

84ed48b4

sampling : rename penalty params + reduce size of "prev" vector

b5265615

sampling : add llama_sampling_print helper

7e2b5fb1

ggerganov force pushed 2 years ago

sampling : hide prev behind API and apply #3661

56ba00b9

ggerganov force pushed to 56ba00b9 2 years ago

ggerganov added need feedback

ggerganov merged d1031cf4 into master 2 years ago

Reviewers

No reviews

Assignees

No one assigned

Labels

need feedback

Milestone

No milestone