DeepSpeed
Keep invalid group-norm sentinels from becoming a finite 1.0 step
#8638
Merged

Keep invalid group-norm sentinels from becoming a finite 1.0 step #8638

sfc-gh-truwase
sfc-gh-truwase sfc-gh-truwase requested a review from tjruwase tjruwase 56 days ago
sfc-gh-truwase sfc-gh-truwase requested a review from tohtana tohtana 56 days ago
sfc-gh-truwase sfc-gh-truwase requested a review from loadams loadams 56 days ago
sfc-gh-truwase sfc-gh-truwase requested a review from jeffra jeffra 55 days ago
sfc-gh-truwase sfc-gh-truwase force pushed from 168c9d16 to 29d4d982 47 days ago
jeffra
jeffra approved these changes on 2026-10-02
PKUWZP PKUWZP requested a review from PKUWZP PKUWZP 47 days ago
PKUWZP
PKUWZP approved these changes on 2026-10-02
sfc-gh-truwase Keep invalid group-norm sentinels from becoming a finite 1.0 step
9e79e4e2
sfc-gh-truwase Move invalid-norm sentinel unit tests to tests/unit/v1
f3a05741
sfc-gh-truwase Keep sentinel tests working with Muon's step path.
75eb961d
sfc-gh-truwase sfc-gh-truwase force pushed from 29d4d982 to 75eb961d 47 days ago
sfc-gh-truwase sfc-gh-truwase merged 991ccf0f into master 43 days ago
sfc-gh-truwase sfc-gh-truwase deleted the fix/invalid-grad-norm-sentinel branch 43 days ago
gpu-test-labeler gpu-test-labeler added skip-gpu-test

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone