Megatron-DeepSpeed
Sync 4 layer norms - bf16, fp32, optimizer states on restart
#274
Open
Open