Add the DRY dynamic N-gram anti-repetition sampler #982
LostRuins
merged
11 commits into
LostRuins:concedo_experimental
from
pi6am:feat/dry-sampler
Add the DRY dynamic N-gram anti-repetition sampler
842f0c6e
Update default DRY parameters to match lite
029f0419
Improve DRY token debug logging
8ed208f4
Merge pull request #1 from LostRuins/concedo
63c4437d
Merge branch 'concedo' into feat/dry-sampler
e2c2ba48
Replace `and` with `&&` to fix MSVC compile error
7a1fb8cf
Fix MSVC compile error because log is not constexpr
cffe69b8
Remove unused llama sampler variables and clean up sequence breakers.
9f5d8fed
Remove KCPP_SAMPLER_DRY as a separate enum entry
ddd0fe2f
Add the dry_penalty_last_n to independently control DRY penalty range
9faf2b0d
Limit sequence breaker lengths in tokens and characters
276556cc
LostRuins
approved these changes
on 2024-07-13
Login to write a write a comment.
Login via GitHub