add device-agnostic GradScaler (#3588)
* add device-agnostic GradScaler
Signed-off-by: Matrix YAO <matrix.yao@intel.com>
* fix bug
Signed-off-by: Matrix YAO <matrix.yao@intel.com>
* fix review comments
Signed-off-by: Matrix YAO <matrix.yao@intel.com>
* fix
Signed-off-by: Matrix YAO <matrix.yao@intel.com>
* format
Signed-off-by: Matrix YAO <matrix.yao@intel.com>
* Apply style fixes
---------
Signed-off-by: Matrix YAO <matrix.yao@intel.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
