diffusers

Optimize test files by fixing CPU-offloading usage

#8409

Merged