diffusers

b47f5115 - [Lora] fix lora fuse unfuse (#5003)

[Lora] fix lora fuse unfuse (#5003) * fix lora fuse unfuse * add same changes to loaders.py * add test --------- Co-authored-by: multimodalart <joaopaulo.passos+multimodal@gmail.com>