transformers
Iterative generation using Input embeds and `past_key_values`
#35890
Merged

Iterative generation using Input embeds and `past_key_values` #35890

yaswanth19
yaswanth19
zucchini-nlp
zucchini-nlp commented on 2025-01-27
zucchini-nlp zucchini-nlp requested a review from gante gante 1 year ago
gante
gante commented on 2025-01-29
yaswanth19 yaswanth19 force pushed from 1890c7bd to 6f624834 1 year ago
yaswanth19
zucchini-nlp
yaswanth19
zucchini-nlp
yaswanth19 yaswanth19 force pushed from 6b208835 to dce13822 1 year ago
yaswanth19 yaswanth19 force pushed from 460f61ac to 37930396 1 year ago
yaswanth19 Iterative generation using input embeds
c0bb1918
yaswanth19 ruff fix
837f6b49
yaswanth19 Added Testcase
cc93cf7e
yaswanth19 Updated comment
1b9d2473
yaswanth19 ♻️ Refactored testcase
380a694c
yaswanth19 Skip test for these models
03a106da
yaswanth19 Continue generation using input embeds and cache
e5af8933
yaswanth19 Skip generate_continue_from_embeds test
21a3341a
yaswanth19 Refactor `prepare_input_for_generation` func
52f9394e
yaswanth19 Continue generation using input embeds and cache
8b718dc5
yaswanth19 yaswanth19 force pushed from 37930396 to 8b718dc5 1 year ago
yaswanth19 Modular changes fix
5eb97d45
yaswanth19
zucchini-nlp
yaswanth19 Overwrite 'prepare_inputs_for_generation' function
73b0ed8f
yaswanth19
yaswanth19 yaswanth19 changed the title Iterative generation using Input embeds and static cache Iterative generation using Input embeds and `past_key_values` 1 year ago
gante
gante approved these changes on 2025-02-05
zucchini-nlp
zucchini-nlp approved these changes on 2025-02-06
zucchini-nlp zucchini-nlp merged 7aee036e into main 1 year ago
lzl-mt

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone