DeepSpeed

1c0b326e - Make lr schedulers support fp16 optimizers (#124)

Make lr schedulers support fp16 optimizers (#124) * add tests cases for onecycle policy with fp16/zero * Make lr schedulers support fp16 optimizers * Fix formatting * More specific naming Co-authored-by: Jeff Rasley <jerasley@microsoft.com>