PR #851 Samyamr/inference hook fix

Fix mis-aligned-grad

samyam committed 5 years ago

Merge branch 'master' into fix-misaligned-grad

GitHub committed 5 years ago

Formatting fix

samyam committed 5 years ago

Adding static_scale test back for Z3, and also changing hidden size to be not divisile by world_size

samyam committed 5 years ago

also removing alignment from flat fp16 buffers

samyam committed 5 years ago

Testing for hidden dim alignment

samyam committed 5 years ago

inference hook fix

samyam committed 5 years ago

Update stage3.py

samyam committed 5 years ago

formatting

jeffra committed 5 years ago

Merge branch 'master' into samyamr/inference-hook-fix

jeffra committed 5 years ago

Merge branch 'master' into samyamr/inference-hook-fix

jeffra committed 5 years ago

[bug-fix] move params to gpu if offload params is turned off

jeffra committed 5 years ago

Merge branch 'master' into samyamr/inference-hook-fix

jeffra committed 5 years ago

DeepSpeed Samyamr/inference hook fix #851 Merged