Iterative generation using Input embeds and `past_key_values` #35890
gante
commented
on 2025-01-29
yaswanth19
force pushed
from
1890c7bd
to
6f624834
1 year ago
yaswanth19
force pushed
from
6b208835
to
dce13822
1 year ago
yaswanth19
force pushed
from
460f61ac
to
37930396
1 year ago
Iterative generation using input embeds
c0bb1918
ruff fix
837f6b49
Added Testcase
cc93cf7e
Updated comment
1b9d2473
♻️ Refactored testcase
380a694c
Skip test for these models
03a106da
Continue generation using input embeds and cache
e5af8933
Skip generate_continue_from_embeds test
21a3341a
Refactor `prepare_input_for_generation` func
52f9394e
Continue generation using input embeds and cache
8b718dc5
yaswanth19
force pushed
from
37930396
to
8b718dc5
1 year ago
Modular changes fix
5eb97d45
Overwrite 'prepare_inputs_for_generation' function
73b0ed8f
yaswanth19
changed the title Iterative generation using Input embeds and static cache Iterative generation using Input embeds and `past_key_values` 1 year ago
gante
approved these changes
on 2025-02-05
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub