PR #286 Support amp deepspeed backend

add amp support for deepspeed (non-ZeRO)

jeffra committed 5 years ago

tests for amp mode

jeffra committed 5 years ago

update docs around amp constants

jeffra committed 5 years ago

add comment about zero and legacy fp16 mode being similar to O2

jeffra committed 5 years ago

fix error in mpu codepath

jeffra committed 5 years ago

DeepSpeed Support amp deepspeed backend #286 Merged