diffusers

[LoRA ]fix flux lora loader when return_metadata is true for non-diffusers

#11716

Merged