transformers
In assisted decoding, pass model_kwargs to model's forward call (fix prepare_input_for_generation in all models)
#25242

Merged

Commits

In assisted decoding, pass model_kwargs to model's forward call

sinking-point committed 2 years ago
Improve variable names in _extend_attention_mask

sinking-point committed 2 years ago
Refactor extending token_type_ids into a function

sinking-point committed 2 years ago
Replace deepcopy with copy to optimize performance

sinking-point committed 2 years ago
Update new persimmon model with llama changes for assisted generation

sinking-point committed 2 years ago
Update new mistral model for assisted generation with prepare_inputs_for_generation

sinking-point committed 2 years ago
Update position_ids creation in falcon prepare_inputs_for_generation to support assisted generation

sinking-point committed 2 years ago