transformers
87d34bfa - [generate] Always correctly restrict assisted decoding with max length/eos token (#48981)

Commit

32 days ago

[generate] Always correctly restrict assisted decoding with max length/eos token (#48981) * do it properly * fix tests * no need to stop on eos inside candidate

References

#48981 - [generate] Always correctly restrict assisted decoding with max length/eos token

Author

Cyrilvallez

Parents

e2d83fdf

transformers 87d34bfa - [generate] Always correctly restrict assisted decoding with max length/eos token (#48981)

transformers
87d34bfa - [generate] Always correctly restrict assisted decoding with max length/eos token (#48981)