DeepSpeed
Enable bf16 check_grad_overflow by default (matching fp16)
#8035
Merged

Enable bf16 check_grad_overflow by default (matching fp16) #8035

yongzhe-wang
yongzhe-wang yongzhe-wang requested a review from tjruwase tjruwase 28 days ago
yongzhe-wang yongzhe-wang requested a review from tohtana tohtana 28 days ago
tohtana
yongzhe-wang
sfc-gh-truwase
sfc-gh-truwase commented on 2026-06-23
sfc-gh-truwase
sfc-gh-truwase sfc-gh-truwase closed this 2 days ago
sfc-gh-truwase sfc-gh-truwase reopened this 2 days ago
sfc-gh-truwase
sfc-gh-truwase approved these changes on 2026-06-23
yongzhe-wang yongzhe-wang force pushed from 46dcf7b4 to 90c4c8b9 1 day ago
tohtana
yongzhe-wang Enable bf16 check_grad_overflow by default (matching fp16)
d6fc7d9e
yongzhe-wang yongzhe-wang force pushed from 90c4c8b9 to d6fc7d9e 10 hours ago
yongzhe-wang
sfc-gh-truwase sfc-gh-truwase enabled auto-merge 2 hours ago
sfc-gh-truwase sfc-gh-truwase merged f0253c86 into master 1 hour ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone