Cleanup workarounds for compiler bug of ROCm (#44579)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/44579
Reviewed By: mruberry
Differential Revision: D23664481
Pulled By: ngimel
fbshipit-source-id: ef698f26455e5827c5b5c0e5d42a1c95bcac8af4
