PR #4010 Re-enable elastic training for torch 2+

Re-enable elastic training for torch 2+ #4010

loadams merged 14 commits into master from loadams/ds-3873

Switch elasticity function

8db1a333

Switch elastic training to support torch 2+

52168040

loadams requested a review from

jeffra 2 years ago

loadams requested a review from

awan-10 2 years ago

Add comment back in

d4d572be

loadams changed the title ~~Loadams/ds 3873~~ Re-enable elastic training for torch 2+ 2 years ago

Move function to runtime.utils

7937fdb3

Formatting and removing newly unused torch import

7e1cd20c

loadams requested a review from

tjruwase 2 years ago

loadams requested a review from

mrwyattii 2 years ago

Merge branch 'master' into loadams/ds-3873

cb99091a

Typo fixed

68b1fb14

Forgot to replace unit with deepspeed.runtime

3cf1bef2

Fixes

77d3c29b

Move more functions away from TORCH_MAJOR

c393e1d6

mrwyattii approved these changes on 2023-07-21

Remove more torch_major

3c485ca2

Fixes

06fa7eea

Remove additional torch_major/minor

ce782ff4

loadams requested a review from

conglongli 2 years ago

Merge branch 'master' into loadams/ds-3873

b2fadf41

loadams enabled auto-merge 2 years ago

loadams merged 6b2365e4 into master 2 years ago

loadams deleted the loadams/ds-3873 branch 1 year ago

Reviewers

mrwyattii

jeffra

awan-10

tjruwase

conglongli

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Re-enable elastic training for torch 2+ #4010 Merged

Re-enable elastic training for torch 2+ #4010

DeepSpeed
Re-enable elastic training for torch 2+
#4010

Merged