transformers
a42ba80f - Allow Exclusion of Input IDs from RepetitionPenaltyLogitsProcessor (#37625)

Commit
239 days ago
Allow Exclusion of Input IDs from RepetitionPenaltyLogitsProcessor (#37625) * Allow exclusion of input IDs for repetition penalty * Add logit proc tests for rep penalty exclusion * Expose rep pen flag through generate * Only slice if needed * keep current rep pen default behavior * Revert exposing reppen changes through generate * Fix test arg * Update src/transformers/generation/logits_process.py Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com> * Rename to rep penalty kwarg * Add custom repetition penalty processor example * Validate prompt_ignore_length --------- Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
Parents
Loading