DeepSpeed
Upgrade apex version, turn off legacy fusion
#205
Merged

Upgrade apex version, turn off legacy fusion #205

jeffra merged 11 commits into master from jeffra/auto_legacy_fusion
jeffra
jeffra auto detect legacy fusion flag if not set
06fad742
jeffra set legacy fusion default to None
8d42bcc5
jeffra jeffra requested a review from tjruwase tjruwase 5 years ago
jeffra update apex version to feb 5th commit
749bf383
tjruwase
tjruwase approved these changes on 2020-04-28
jeffra since we're upgrading apex versions we don't need this torch version …
cb1f6a98
jeffra jeffra changed the title Auto legacy fusion Upgrade apex version, turn off legacy fusion 5 years ago
jeffra use gradient clipping instead of max grad norm in tests
f9da7ac0
jeffra add warning when user provides max_grad_norm
5394515a
jeffra temporarily switch DeepSpeedExamples to one with new apex compatabili…
86f4dd66
jeffra formatting
cd22736f
jeffra Merge branch 'master' into jeffra/auto_legacy_fusion
2d587bbc
tjruwase
tjruwase approved these changes on 2020-04-30
jeffra update examples commit
074c6f22
jeffra Merge branch 'master' into jeffra/auto_legacy_fusion
7a345f0b
jeffra jeffra merged 3ce531c9 into master 5 years ago
jeffra jeffra deleted the jeffra/auto_legacy_fusion branch 5 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone