DeepSpeed
[Bug fix] WarmupCosineLR issues
#4688
Merged
Overview
Commits
2
Changes
View On GitHub

[Bug fix] WarmupCosineLR issues #4688

tjruwase merged 2 commits into deepspeedai:master from sbwww:WarmupCosineLR_fix
sbwww
sbwww fix WarmupCosineLR inverse_log_warm_up math domain error
131abb7f
sbwww sbwww requested a review from jeffra jeffra 2 years ago
sbwww sbwww requested a review from tjruwase tjruwase 2 years ago
sbwww sbwww changed the title fix WarmupCosineLR inverse_log_warm_up math domain error [Bug fix] WarmupCosineLR inverse_log_warm_up math domain error 2 years ago
tjruwase
tjruwase approved these changes on 2023-11-16
sbwww add get_last_lr to WarmupCosineLR
77dbd51d
sbwww
sbwww sbwww changed the title [Bug fix] WarmupCosineLR inverse_log_warm_up math domain error [Bug fix] WarmupCosineLR issues 2 years ago
tjruwase
tjruwase
tjruwase tjruwase merged ce0ebdad into master 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum