transformers
🚨🚨 Setting default behavior of assisted decoding
#33657

Merged

🚨🚨 Setting default behavior of assisted decoding #33657

gante merged 8 commits into huggingface:main from jmamou:default-SL

gante approved these changes on 2024-09-24

gante requested a review from

LysandreJik 1 year ago

ArthurZucker commented on 2024-09-24

ArthurZucker approved these changes on 2024-09-24

gante changed the title ~~Setting default behavior of assisted decoding~~ 🚨🚨 Setting default behavior of assisted decoding 1 year ago

setting default to Dynamic number of speculative tokens

0ee4ba08

add test

508be73e

fix style

c3bbdbd9

add is_assistant config

e93ba952

fix style

f41cde07

fix tests

1848c589

moving is_assistant = True from utils.generate to candidate_generator

7867558f

Update src/transformers/generation/utils.py

c1884986

gante force pushed to c1884986 1 year ago

gante merged 52daf4ec into main 1 year ago

jmamou deleted the default-SL branch 1 year ago

Reviewers

ArthurZucker

gante

LysandreJik

Assignees

No one assigned

Labels

None yet

Milestone

No milestone