DeepSpeed

aa3f2893 - ZeRO-Offload passing model functionality tests (#366)

ZeRO-Offload passing model functionality tests (#366) * cpu_offload enables overlap_comm and contiguous_gradients Remove non-portable tensor.mul_() * Model functionality tests now passing * Move to perf tests folder