Add beam search, diverse beam search, and beam sampling to generate() #1539
Add beam search support with BeamHypotheses and BeamSearchScorer classes
fe43e7e5
justsml
changed the title Add beam search support with BeamHypotheses and BeamSearchScorer classes Add beam search decoding to generate() 24 days ago
justsml
marked this pull request as ready for review 24 days ago
Add diverse beam search support
cc27cb08
Add beam sampling for beam search
2b1f5aec
justsml
changed the title Add beam search decoding to generate() Add beam search, diverse beam search, and beam sampling to generate() 24 days ago
Refactor model input expansion for beam search to use index selection
1cad78c0
Handle past_key_values for beam search in PreTrainedModel to prevent …
b9d908e4
Simplify past_key_values handling in PreTrainedModel for beam search
ccf1a43f
Merge branch 'main' into dan/add-beam-support
ad10b094
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub