DeepSpeed
Keep float32 intermediates in the clamped SwiGLU eager fallback
#8992
Merged
Merged
Keep float32 intermediates in the clamped SwiGLU eager fallback #8992
delock
merged
1 commit into
deepspeedai:master
from
GuCarpenter:fix/swiglu-oai-eager-fallback-fp32
Keep float32 intermediates in the clamped SwiGLU eager fallback
0d630e81
delock
approved these changes
on 2026-11-04
Login to write a write a comment.
Login via GitHub