Implementation of cyclical learning rate (#23914)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/23914
Implementation of cyclical learning rate, see https://arxiv.org/pdf/1506.01186.pdf
Test Plan: canary: https://fburl.com/fblearner/siqb34md
Reviewed By: chenshouyuan
Differential Revision: D16632831
fbshipit-source-id: 20bd9d7fb61af5a8b594b039c5d434a0cc96fadc
