PR #27979 Generate: speculative decoding

Generate: speculative decoding #27979

gante merged 8 commits into huggingface:main from gante:candidate_generate_refactor

gante force pushed 2 years ago

gante requested a review from

patrickvonplaten 2 years ago

gante requested a review from

amyeroberts 2 years ago

gante marked this pull request as ready for review 2 years ago

gante commented on 2023-12-12

speculative decoding

8dbb065b

fix test

a726936b

space

7e4deaba

better comments

e234e1ef

gante force pushed to e234e1ef 2 years ago

remove redundant test

b4dab21d

test nit

f2f99f34

amyeroberts commented on 2023-12-15

patrickvonplaten commented on 2023-12-15

Apply suggestions from code review

64c59a51

PR comments

c7f1d12c

patrickvonplaten approved these changes on 2023-12-18

amyeroberts approved these changes on 2023-12-18

gante merged ac974199 into main 2 years ago

gante deleted the candidate_generate_refactor branch 2 years ago

Reviewers

amyeroberts

patrickvonplaten

Assignees

No one assigned

Labels

None yet

Milestone

No milestone