transformers
[Backend support] Allow `num_logits_to_keep` as Tensor and change it to `logits_to_keep` + add flag
#35757

Merged

[Backend support] Allow `num_logits_to_keep` as Tensor and change it to `logits_to_keep` + add flag #35757

Cyrilvallez merged 7 commits into main from tgi-support

Cyrilvallez requested a review from

zucchini-nlp 1 year ago

Cyrilvallez requested a review from

ArthurZucker 1 year ago

Cyrilvallez requested a review from

Rocketknight1 1 year ago

ArthurZucker approved these changes on 2025-01-20

support

2bec2c42

Update modeling_utils.py

9c8c58f1

style

72320083

most models

75612baf

Other models

65df3d2a

fix-copies

c26ff5f6

tests + generation utils

e35d31d2

Cyrilvallez force pushed to e35d31d2 1 year ago

ArthurZucker approved these changes on 2025-01-23

Cyrilvallez merged d3af76df into main 1 year ago

Cyrilvallez deleted the tgi-support branch 1 year ago

Cyrilvallez changed the title ~~[Backend support] Allow `num_logits_to_keep` as Tensor + add flag~~ [Backend support] Allow `num_logits_to_keep` as Tensor and change it to `logits_to_keep` + add flag 1 year ago

Reviewers

ArthurZucker

zucchini-nlp

Rocketknight1

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers [Backend support] Allow `num_logits_to_keep` as Tensor and change it to `logits_to_keep` + add flag #35757 Merged

[Backend support] Allow `num_logits_to_keep` as Tensor and change it to `logits_to_keep` + add flag #35757

transformers
[Backend support] Allow `num_logits_to_keep` as Tensor and change it to `logits_to_keep` + add flag
#35757

Merged