[quant][graphmode] use RemoveMutation to remove append (#41161)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/41161
Test Plan: Imported from OSS
Reviewed By: z-a-f
Differential Revision: D22446714
fbshipit-source-id: 15da28ef773300a141603d67a1c4524f1ec32239
