DeepSpeed

01e848b3 - Default Contiguous Gradients False (#239)

Default Contiguous Gradients False (#239) Contiguous Gradients should be set to false by default. Its not useful unless the model is very large