diffusers

ce9825b5 - [LoRA] pop the LoRA scale so that it doesn't get propagated to the weeds (#7338)

[LoRA] pop the LoRA scale so that it doesn't get propagated to the weeds (#7338) * pop scale from the top-level unet instead of getting it. * improve readability. * Apply suggestions from code review Co-authored-by: YiYi Xu <yixu310@gmail.com> * fix a little bit. --------- Co-authored-by: YiYi Xu <yixu310@gmail.com>