diffusers

[LoRA tests] fix stuff related to assertions arising from the recent changes.

#6448

Merged