Allow Exclusion of Input IDs from RepetitionPenaltyLogitsProcessor (#37625)
* Allow exclusion of input IDs for repetition penalty
* Add logit proc tests for rep penalty exclusion
* Expose rep pen flag through generate
* Only slice if needed
* keep current rep pen default behavior
* Revert exposing reppen changes through generate
* Fix test arg
* Update src/transformers/generation/logits_process.py
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
* Rename to rep penalty kwarg
* Add custom repetition penalty processor example
* Validate prompt_ignore_length
---------
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>