fix conv unit test for groupwise quantization and pre-packing (#15761)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/15761
As title says.
Reviewed By: csummersea
Differential Revision: D13587727
fbshipit-source-id: f0631b8cbb89d65a1d952bc25b463de23de93bec
