Fix for "AttributeError when attempting to remove inductor buffers twice" (#104901)
Fixes #102857
I added the proposed fix and found a reasonably small test case. I don't have any insight into why this test case was causing the error, but it is fixed now.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/104901
Approved by: https://github.com/eellison
