match old fuser rem to eager (#37196)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/37196
Reviewed By: zdevito
Differential Revision: D21223172
Pulled By: Krovatkin
fbshipit-source-id: 4d4ff1127d5dc69ab73f07ca79c1f5b0b4dd9732
