diffusers

[Tests] Optimize test configurations for faster execution

#5535

Merged