fix assisted decoding assistant model inputs #27503
fix assisted decoding attention_cat
dd36dd10
jiqing-feng
marked this pull request as ready for review 2 years ago
fix attention_mask for assisted decoding
3a21adaa
fix attention_mask len
5295d31d
fix attn len
6664ab72
Use a more clean way to prepare assistant models inputs
d19ad6f6
fix param meaning
fd0bc764
fix param name
7996be5b
fix assistant model inputs
dadece9c
update token type ids
41eb39de
jiqing-feng
changed the title fix assisted decoding attention_cat fix assisted decoding assistant model inputs 2 years ago
gante
commented
on 2023-11-15
fix assistant kwargs copy
5721a636
Merge branch 'huggingface:main' into assisted
7fcd4ffc
add encoder-decoder tests of assisted decoding
5a386251
check if assistant kwargs contains updated keys
7658269b
gante
approved these changes
on 2023-11-16
gante
commented
on 2023-11-16
revert test
f984aaec
Merge branch 'huggingface:main' into assisted
0b2f79e1
fix conflict
f7502ee3
fix whisper tests
f01006bb
merge main
10303283
Merge branch 'main' into assisted
fea33ea3
fix assistant kwargs
eeffe135
revert whisper test
af36fe9b
gante
approved these changes
on 2023-11-21
Merge branch 'huggingface:main' into assisted
03a06483
delete _extend funcs
9e0ca1c9
gante
merged
1d7f406e
into main 2 years ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub