transformers
7aee036e - Iterative generation using Input embeds and `past_key_values` (#35890)

Commit
340 days ago
Iterative generation using Input embeds and `past_key_values` (#35890) * Iterative generation using input embeds * ruff fix * Added Testcase * Updated comment * ♻️ Refactored testcase * Skip test for these models * Continue generation using input embeds and cache * Skip generate_continue_from_embeds test * Refactor `prepare_input_for_generation` func * Continue generation using input embeds and cache * Modular changes fix * Overwrite 'prepare_inputs_for_generation' function
Author
Parents
Loading