[quant][graphmode][fx][fix] Remove qconfig in convert (#44526)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/44526
Test Plan: Imported from OSS
Reviewed By: vkuzo
Differential Revision: D23641960
fbshipit-source-id: 546da1c16694d1e1dfb72629085acaae2165e759
