Revert "[CUDA graphs] Clear autocast amp cache (#81558)"
This reverts commit e9d07bd4f0b8d0894566dca61e39909afb2d29ec.
Reverted https://github.com/pytorch/pytorch/pull/81558 on behalf of https://github.com/janeyx99 due to Breaks windows 11.6 tests on trunk https://hud.pytorch.org/pytorch/pytorch/commit/e9d07bd4f0b8d0894566dca61e39909afb2d29ec
