DeepSpeed

bc451c09 - revert part of #1220 (#1221)

revert part of #1220 (#1221) https://github.com/microsoft/DeepSpeed/pull/1220 fixed the leak, but lead to another problem. reverting that part so that we could do release and will work on it after the release. @jeffra