Megatron-DeepSpeed

084c3d0c - [microsoft/Megatron-DeepSpeed sync] Commits including Jul 26, 2021 (#29)

[microsoft/Megatron-DeepSpeed sync] Commits including Jul 26, 2021 (#29) * pipe transformer docstring * improve DS integration evaluation + logging Co-authored-by: Shaden Smith <shaden.smith@microsoft.com>