removing conv filters from conv pattern matching (#44512)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/44512
Test Plan: Imported from OSS
Reviewed By: jerryzh168
Differential Revision: D23637409
Pulled By: z-a-f
fbshipit-source-id: ad5be0fa6accfbcceaae9171bf529772d87b4098
