DeepSpeed

e419f7cb - Match compute and reduce dtype (#2145)

Match compute and reduce dtype (#2145) * Match compute and reduce dtype * Unit tests Co-authored-by: Jeff Rasley <jerasley@microsoft.com>