Revert D25222215: [quant][fix] Add bias once in conv_fused
Test Plan: revert-hammer
Differential Revision:
D25222215 (https://github.com/pytorch/pytorch/commit/d2e429864cb27318476537fea5e55e2beaaffc68)
Original commit changeset: 90c0ab79835b
fbshipit-source-id: 5c8eee107309cfa99cefdf439a62de0b388f9cfb