DeepSpeed
updates to amp to support grad clip and grad accumulation
#290
Merged
Overview
Commits
10
Changes
View On GitHub

updates to amp to support grad clip and grad accumulation #290

jeffra merged 10 commits into master from jeffra/amp-updates
jeffra
jeffra updates to amp to support grad clip and grad accumulation
774906b2
jeffra formatting
9231c432
jeffra update grad clip with link
0b3ab8ea
jeffra fix syntax error
ec11c0f9
jeffra comment
b39b1e37
jeffra Merge branch 'master' into jeffra/amp-updates
15c6a8f8
jeffra jeffra requested a review from tjruwase tjruwase 5 years ago
jeffra jeffra requested a review from samyam samyam 5 years ago
tjruwase
tjruwase approved these changes on 2020-07-16
jeffra zero grad using optimizer if in amp mode
1c48ec22
Liyang90
Liyang90 commented on 2020-07-17
jeffra Merge branch 'master' into jeffra/amp-updates
7d9bfae5
jeffra fix bug
e313de8c
jeffra Merge branch 'master' into jeffra/amp-updates
f0ab9c65
jeffra jeffra merged eb74c3f1 into master 5 years ago
jeffra jeffra deleted the jeffra/amp-updates branch 5 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum