diffusers

[LoRA] add: test to check if peft loras are loadable in non-peft envs.

#6400

Merged