diffusers

[LoRA] pop the LoRA scale so that it doesn't get propagated to the weeds

#7338

Merged