Adding Prompt lookup decoding (#27775)
* MVP
* fix ci
* more ci
* remove redundant kwarg
* added and wired up PromptLookupCandidateGenerator
* rebased with main, working
* removed print
* style fixes
* fix test
* fixed tests
* added test for prompt lookup decoding
* fixed circleci
* fixed test issue
* Update src/transformers/generation/candidate_generator.py
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
* Update src/transformers/generation/candidate_generator.py
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
* Update src/transformers/generation/candidate_generator.py
* Update src/transformers/generation/candidate_generator.py
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
---------
Co-authored-by: Joao Gante <joao@huggingface.co>
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
