PR #7171 Fix issue #5242 grad_norm and loss is nan

Fix issue #5242 grad_norm and loss is nan #7171

hwchen2017 merged 4 commits into deepspeedai:master from Glaceon-Hyy:fix_grad_norm

Glaceon-Hyy requested a review from

tjruwase 341 days ago

Glaceon-Hyy requested a review from

tohtana 341 days ago

loadams commented on 2025-03-25

Fix issue #5242 grad_norm and loss is nan

38952e6b

Fix format

b6e78d98

handle total_norm invalid value

49f38a1f

Glaceon-Hyy force pushed from 972c8c02 to 632fefe0 339 days ago

Glaceon-Hyy force pushed from 632fefe0 to 49f38a1f 339 days ago

Merge branch 'master' into fix_grad_norm

409f9cc5

tjruwase approved these changes on 2025-03-28

hwchen2017 merged 1f706621 into master 337 days ago

Reviewers

tjruwase

loadams

tohtana

Assignees

No one assigned

Labels

None yet

Milestone

No milestone