DeepSpeed
Expose Consecutive Hysteresis to Users
#3553
Merged

Expose Consecutive Hysteresis to Users #3553

Quentin-Anthony
Quentin-Anthony Expose consecutive_hysteresis to users through config
717cda7f
Quentin-Anthony Make var name consistent
e1e9afec
Quentin-Anthony Add log message and formatting changes
7529ae47
Quentin-Anthony Quentin-Anthony requested a review from jeffra jeffra 2 years ago
Quentin-Anthony Quentin-Anthony requested a review from tjruwase tjruwase 2 years ago
Quentin-Anthony Quentin-Anthony requested a review from mrwyattii mrwyattii 2 years ago
Quentin-Anthony Merge branch 'master' into consecutive_hysteresis
bf9f26a3
Quentin-Anthony Merge branch 'master' into consecutive_hysteresis
ce297ba7
Quentin-Anthony Merge branch 'master' into consecutive_hysteresis
f66e1a7b
Quentin-Anthony Wrap hysteresis message in root rank check
d3a48460
Quentin-Anthony Propagate consecutive_hysteresis as loss_scale_args member
156ef6c1
jeffra
jeffra commented on 2023-05-24
jeffra
jeffra commented on 2023-05-24
jeffra Merge branch 'master' into consecutive_hysteresis
6a7113b5
jeffra Merge branch 'master' into consecutive_hysteresis
74be76fb
jeffra
jeffra approved these changes on 2023-05-25
jeffra jeffra merged 0411a9f8 into master 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone