diffusers

[tests] make cuda only tests device-agnostic

#11058

Merged