diffusers

[gguf] Refactor __torch_function__ to avoid unnecessary computation

#11551

Merged