Add option to clean up allocated activations between c2 runs (#29619)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/29619
att
Reviewed By: houseroad
Differential Revision: D18415190
fbshipit-source-id: 739aaf436578fac635df10de42b35e2b4368df37
