Ignore user annotated ignored attributes (#52367)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/52367
This fixes https://github.com/pytorch/pytorch/issues/52217
Test Plan: Imported from OSS
Reviewed By: navahgar, gmagogsfm
Differential Revision: D26574411
Pulled By: tugsbayasgalan
fbshipit-source-id: 7eac097f5b97cfe65854bceca14d41c156cd6e0a
