DeepSpeed
Fix MegatronLayerPolicy to have megatron_v2=True
#2579
Merged

Commits
  • Fix MegatronLayerPolicy to have megatron_v2=True
    lekurile committed 3 years ago
  • Make megatron_v2 a Megatron policy class variable
    lekurile committed 3 years ago
Loading