add option to disable pipeline partitioning (#4322)
added pipeline configuration to deepspeed config under pipeline section
pipe_partitioned = "auto"
grad_partitioned = "auto"
can be used to enable or disable activations and grads partitioning in
TP/PP mode
Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Logan Adams <114770087+loadams@users.noreply.github.com>
