Revert D32154788: Move Concat Linear out of Optimize Numerics
Test Plan: revert-hammer
Differential Revision:
D32154788 (https://github.com/pytorch/pytorch/commit/ea94dde5737c559c3d02388376e3be5d15abbcf2)
Original commit changeset: faa6465c89b3
fbshipit-source-id: 0dcaa65268b68ed01e6a5bc7b73ade1f51163b33
