PR #32895 Improve greedy search memory usage

Improve greedy search memory usage #32895

gante merged 1 commit into huggingface:main from regisss:enhance_greedy_search_memory

regisss marked this pull request as ready for review 1 year ago

regisss requested a review from

gante 1 year ago

zucchini-nlp approved these changes on 2024-08-21

gante approved these changes on 2024-08-21

amyeroberts approved these changes on 2024-08-22

gante force pushed 1 year ago

Do not call torch.repeat_interleave if expand_size is 1

23f74a11

gante force pushed to 23f74a11 1 year ago

gante merged 99d67f1a into main 1 year ago

regisss deleted the enhance_greedy_search_memory branch 1 year ago

Reviewers

zucchini-nlp

amyeroberts

gante

Assignees

No one assigned

Labels

None yet

Milestone

No milestone