Revert "extend serialization for tensor metadata (#99808)"
This reverts commit 73dd6f04c97f647470dbc55e03f666fa88f634c3.
Reverted https://github.com/pytorch/pytorch/pull/99808 on behalf of https://github.com/atalman due to breaking internal builds ([comment](https://github.com/pytorch/pytorch/pull/99808#issuecomment-1536823538))