[quant][graphmode][fx] cleanup linear module test case (#50976)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/50976
Test Plan: Imported from OSS
Reviewed By: supriyar
Differential Revision: D26032531
fbshipit-source-id: 9725bab8f70ac79652e7bf9f94376917438d60e0
