change the location of wipe cache (#24454)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/24454
We want to change the place of wipe_cache. From what we observed, the original place does not help.
Reviewed By: mingzhe09088
Differential Revision: D16853205
fbshipit-source-id: 1f6224a52433cbe15c0d27000b4ac140fb9cd4c3
