DeepSpeed
Fix MegatronLayerPolicy to have megatron_v2=True
#2579

Merged

Fix MegatronLayerPolicy to have megatron_v2=True #2579

lekurile merged 2 commits into master from lekurile/fix_megatron_v2_policy_flag

Fix MegatronLayerPolicy to have megatron_v2=True

a53e3fc1

lekurile requested a review from

RezaYazdaniAminabadi 3 years ago

lekurile requested a review from

jeffra 3 years ago

lekurile requested a review from

mrwyattii 3 years ago

lekurile requested a review from

awan-10 3 years ago

lekurile requested a review from

cmikeh2 3 years ago

lekurile requested a review from

arashb 3 years ago

RezaYazdaniAminabadi commented on 2022-12-07

RezaYazdaniAminabadi approved these changes on 2022-12-07

Make megatron_v2 a Megatron policy class variable

5b257abb

jeffra approved these changes on 2022-12-07

lekurile merged 731965db into master 3 years ago

mrwyattii deleted the lekurile/fix_megatron_v2_policy_flag branch 3 years ago

lekurile assigned

lekurile 3 years ago

Reviewers

jeffra

mrwyattii

awan-10

cmikeh2

arashb

Assignees

lekurile

Labels

None yet

Milestone

No milestone