onnxruntime

5ee47e3f - legacy_megatron-lm/deepspeed_ZERO1&2 FP16_Optimizer wrapper (#9184)

legacy_megatron-lm/deepspeed_ZERO1&2 FP16_Optimizer wrapper (#9184) * megatron-lm FP16_Optimizer Wrap, allow model parallelism aggregation optional * add deepspeed zero1 and zero2 - checkoverflow & clip norm * re-structure code and add the copyright * update the document * refine the code after validation