transformers
Generate: assistant should be greedy in assisted decoding
#30778

Merged

Generate: assistant should be greedy in assisted decoding #30778

gante merged 3 commits into huggingface:main from gante:assistant_should_use_greedy

assistant should be greedy

2cd1649b

gante requested a review from

amyeroberts 2 years ago

gante requested a review from

zucchini-nlp 2 years ago

better comment

6812715e

gante commented on 2024-05-13

amyeroberts approved these changes on 2024-05-13

Update src/transformers/generation/candidate_generator.py

5ea41500

gante merged 2e27291c into main 2 years ago

gante deleted the assistant_should_use_greedy branch 2 years ago

Reviewers

amyeroberts

zucchini-nlp

Assignees

No one assigned

Labels

None yet

Milestone

No milestone