PR #4367 Tweak default server sampling parameters

Tweak default server sampling parameters #4367

ggerganov merged 2 commits into ggml-org:master from kalomaze:tweak-defaults

Set a more typical Top P setting as the default

9dabc906

Update temp max

4c321179

kalomaze changed the title ~~Set a more typical Top P setting as the default for the server~~ Tweak default server sampling parameters 1 year ago

ggerganov merged fecac456 into master 1 year ago

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone