DeepSpeed

8abdaee2 - Add cpu adagrad (#1358)

Add cpu adagrad (#1358) Co-authored-by: Jeff Rasley <jerasley@microsoft.com> Co-authored-by: Reza Yazdani <44502768+RezaYazdaniAminabadi@users.noreply.github.com>