DeepSpeed

eb74c3f1 - updates to amp to support grad clip and grad accumulation (#290)

updates to amp to support grad clip and grad accumulation (#290) * updates to amp to support grad clip and grad accumulation * zero grad using optimizer if in amp mode