Fix contrastive search to correctly handle input with padding #33507
gante
commented
on 2024-09-17
fix: handle padding in contrastive search for decoder-only models
055b692b
fix: handle padding in contrastive search for encoder-decoder models
daa26963
tests: move padding contrastive test to test_util, add t5 test
a10ec988
fix: handle if model_kwargs["decoder_attention_mask"] is None
6a86c0d5
refactor: improve padding input contrastive search generation tests
b8a08dd7
chore: _ranking_fast to use LongTensor for cosine_matrix_mask
21d0207d
ducviet00
changed the title Fix contrastive search to correctly handle input padding in decoder-only models Fix contrastive search to correctly handle input padding 1 year ago
ducviet00
changed the title Fix contrastive search to correctly handle input padding Fix contrastive search to correctly handle input with padding 1 year ago
gante
approved these changes
on 2024-09-19
gante
merged
dc8b6eae
into main 1 year ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub