Update optimizer accessors to influence dependencies (#1460)
Summary:
If we update an optimizer, we should also update its dependents (e.g., lr_scheduler and anything else that may need to be reconstructed)
Pull Request resolved: https://github.com/pytorch/benchmark/pull/1460
Reviewed By: xuzhao9
Differential Revision: D43878426
Pulled By: janeyx99
fbshipit-source-id: 1639f0bc9e722e31eb1dbe16da22704b58ceebf9
