Revert "Memory layout for pooling ops" (#25495)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/25495
This reverts commit 8dcd256201a16827bae3610fe05f6566cce787d0.
Test Plan: Imported from OSS
Differential Revision: D17139716
Pulled By: jamesr66a
fbshipit-source-id: 5f4a12e4048e8a50f8400fcde7de1fbce1495d37
