diffusers
Fix `Ideogram4MRoPE` collapsing under `torch.autocast` (compute rotary in float32)
#13922
Merged
Merged
Fix `Ideogram4MRoPE` collapsing under `torch.autocast` (compute rotary in float32) #13922
dg845
merged
12 commits into
huggingface:main
from
HaozheZhang6:fix/ideogram4-rope-autocast
Fix `Ideogram4MRoPE` collapsing under `torch.autocast` (compute rotar…
33c76774
sayakpaul
commented
on 2026-06-12
Compute the rotary frequencies in float64 instead of disabling autocast
717d13c2
Merge branch 'main' into fix/ideogram4-rope-autocast
81955e9a
Merge branch 'main' into fix/ideogram4-rope-autocast
0081d613
Merge branch 'main' into fix/ideogram4-rope-autocast
7cd6749d
Merge branch 'main' into fix/ideogram4-rope-autocast
606b0969
dg845
commented
on 2026-06-18
dg845
commented
on 2026-06-18
Disable autocast for Ideogram4 rope matmul instead of using float64
e8564d25
dg845
commented
on 2026-06-18
Disable autocast for ernie_image and helios rope einsum
508e5350
Disable autocast for Cosmos3 VL-text rope matmul
0cadcfc0
Merge branch 'main' into fix/ideogram4-rope-autocast
f4552565
Merge branch 'main' into fix/ideogram4-rope-autocast
bae53aa3
dg845
approved these changes
on 2026-06-19
Tighten autocast(enabled=False) to just the rope matmul
bd834c02
Login to write a write a comment.
Login via GitHub