Megatron-DeepSpeed

3b22aa21 - print number of params only on rank 0 (#140)

print number of params only on rank 0 (#140) * print number of params only on rank 0 * update requirements * failing test with 4gpus, try 2 gpus