diffusers

[CI] Fix for failing IP Adapter test in Fast GPU PR tests

#10915

Merged