DeepSpeed
Enable grad scaler for ZeRO-0 + torch.autocast path
#7619

Merged

Enable grad scaler for ZeRO-0 + torch.autocast path #7619

sfc-gh-truwase merged 7 commits into deepspeedai:master from tohtana:tohtana/enable_gradscaler_z0

show mismatching values when test fails

43526d6c

Merge branch 'master' into tohtana/improve_log_dc_test_failure

a448ac15

include mismatch value in exception message

86007af3

Merge branch 'master' into tohtana/enable_gradscaler_z0

18a65a5b

enable gradsclaer for z0+torch.autocast

e6bc0987

tohtana changed the title ~~Enable grad scaler for ZeRO-0~~ Enable grad scaler for ZeRO-0 + torch.autocast path 87 days ago

tohtana marked this pull request as ready for review 87 days ago

tohtana requested a review from

tjruwase 87 days ago

tohtana requested a review from

loadams 87 days ago

remove hard-coded tolerances

f779b645

sfc-gh-truwase approved these changes on 2025-10-04

Merge branch 'master' into tohtana/enable_gradscaler_z0

d1cf5609

sfc-gh-truwase enabled auto-merge (squash) 87 days ago

sfc-gh-truwase merged 71d077da into master 87 days ago

Reviewers

sfc-gh-truwase

tjruwase

loadams

Assignees

No one assigned

Labels

None yet

Milestone

No milestone