DeepSpeed
[Engine] Only scale gradients if scale_wrt_gas is True
#7724

Merged

[Engine] Only scale gradients if scale_wrt_gas is True #7724

tohtana merged 5 commits into deepspeedai:master from kashif:fix-hook

kashif requested a review from

tjruwase 38 days ago

kashif requested a review from

tohtana 38 days ago

Only scale gradients if scale_wrt_gas is True

a1f022bd

kashif force pushed from 271dfca7 to a1f022bd 38 days ago

tohtana approved these changes on 2025-12-11

add test to verify scale_wrt_gas=False

149b22f9

Merge pull request #1 from tohtana/tohtana/add_test_disable_scaling

01e6d730

kashif requested a review from

loadams 37 days ago

Merge branch 'master' into fix-hook

5df5d990

dry up the method

1428da69

kashif force pushed from 52e2120f to 1428da69 37 days ago

tohtana enabled auto-merge (squash) 37 days ago

tohtana merged d568375e into master 37 days ago

kashif deleted the fix-hook branch 37 days ago

Reviewers

tohtana

tjruwase

loadams

Assignees

No one assigned

Labels

None yet

Milestone

No milestone