Remove duplicate check for THPLayout in toSugaredValue (#51543)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/51543
Reviewed By: Lilyjjo
Differential Revision: D26202297
Pulled By: gmagogsfm
fbshipit-source-id: f0d40c9d73b579a68e34c54b004d329fd3b76ff3
