Ensure `num_logits_to_keep` is always set to 1 for generate calls #1681
support scalar tensor tolist()
39979646
gemma support num_logits_to_keep
9e274ad5
set num_logits_to_keep in phi3_v and chatterbox too
b64f66cb
set num_logits_to_keep in qwen2_vl and multi_modality
ac4d7a51
allow num_logits_to_keep to be used in encoder-decoder models
db98a702
Deduplicate set logic
2157e5d4
Merge branch 'main' into num_logits_to_keep-fix
ce0136f1
xenova
merged
3dc58cbc
into main 39 days ago
xenova
deleted the num_logits_to_keep-fix branch 39 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub