diffusers

[ip-adapter] make sure length of `scale` is same as number of ip-adapters when using `set_ip_adapter_scale`

#6884

Merged