DeepSpeed

81039463 - [zero3] release tmp memory when consolidating fp16 weights take2 (#1223)

[zero3] release tmp memory when consolidating fp16 weights take2 (#1223) * release tmp memory when consolidating fp16 weights take2 * cleanup Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>