diffusers

b8ec64cd - [core] fix group offloading when using torchao (#13276)

[core] fix group offloading when using torchao (#13276) * fix group offloading when using torchao * switch to swap_tensors. * up * address feedback. * error out for the offload to disk option.