DeepSpeed

c9fee821 - contiguous gradients should be set to True by default (#1199)

contiguous gradients should be set to True by default (#1199) * contiguous gradients should be set to True by default * Set contiguous gradients to True by default Features such as reduce_scatter depends on contiguous gradients being True. This is also the preferred default configuration.