diffusers

Correctly keep vae in `float16` when using PyTorch 2 or xFormers

#4019

Merged