transformers
In assisted decoding, pass model_kwargs to model's forward call (fix prepare_input_for_generation in all models)
#25242
Merged
Merged
In assisted decoding, pass model_kwargs to model's forward call (fix prepare_input_for_generation in all models) #25242
patrickvonplaten
merged
7 commits into
huggingface:main
from
sinking-point:sinking-point/assisted-decoding-model-kwargs-fix-all-models-25020
sinking-point
changed the title
gante
approved these changes
on 2023-10-10
In assisted decoding, pass model_kwargs to model's forward call
d8dd9867
Improve variable names in _extend_attention_mask
977dd727
Refactor extending token_type_ids into a function
8ce58b46
Replace deepcopy with copy to optimize performance
81a04c24
Update new persimmon model with llama changes for assisted generation
2ee2e797
Update new mistral model for assisted generation with prepare_inputs_…
008e7caa
Update position_ids creation in falcon prepare_inputs_for_generation …
8ce040de
patrickvonplaten
approved these changes
on 2023-10-11
sinking-point
deleted the sinking-point/assisted-decoding-model-kwargs-fix-all-models-25020 branch 2 years ago
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub