diffusers

enable test_layerwise_casting_memory cases on XPU

#11406

Merged