remove redundant inference functions for FC (#17407)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/17407
As title says
Reviewed By: csummersea
Differential Revision: D14177921
fbshipit-source-id: e48e1086d37de2c290922d1f498e2d2dad49708a
