remove constant pooling expect (#21003)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/21003
ghimport-source-id: c1e0d0555758cab12ce82e0283bab559c7e8e4e2
Differential Revision: D15523443
Pulled By: wanchaol
fbshipit-source-id: 40973c1c0c0ab07fe4b1334e9ae0e4b16b5add8e