DeepSpeed

d3550dc8 - Adagrad support in ZeRO (#3401)

Adagrad support in ZeRO (#3401) * Adding torch.optim.Adagrad * adding adagrad for zero 1 2 * Adding Adagrad support to zero 3. * Adding documentation and DeepSpeedCPUAdagrad to list. --------- Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>