[SPMD] Make the IterGraphModule less verbose and more profiling friendly (#96969)
Make the IterGraphModule less verbose and more profiling friendly
Differential Revision: [D44110594](https://our.internmc.facebook.com/intern/diff/D44110594/)
Pull Request resolved: https://github.com/pytorch/pytorch/pull/96969
Approved by: https://github.com/mrshenli