transformers

bc3e20dc - [`Llama`] remove prompt and fix prefix finetuning (#25565)

[`Llama`] remove prompt and fix prefix finetuning (#25565) * nit * update * make sure use_default_system_prompt is saved * update checkpointing * consistency * use_default_system_prompt for test