transformers

16780c86 - Drop multimodal inputs natively in prepare_inputs_for_generation if not in prefill (#47622)

Drop multimodal inputs natively in prepare_inputs_for_generation if not in prefill (#47622) * move to general one * better comment * more * more more * move outside * switch default * fix random bugs that were skipped by mistake