Disable Mixtral `output_router_logits` during inference #29249
ArthurZucker
merged
4 commits into
huggingface:main
from
LeonardoEmili:mixtral_output_router_logits
Set output_router_logits=False in prepare_inputs_for_generation for m…
7ee1e517
LeonardoEmili
changed the title 
ArthurZucker
commented
on 2024-02-27
Merge branch 'huggingface:main' into mixtral_output_router_logits
ee3d3eec
Add output_router_logits=False to prepare_inputs_for_generation for m…
8c54fe7c
ArthurZucker
approved these changes
on 2024-02-28
Fix style
09b1c78f
Login to write a write a comment.
Login via GitHub