Revert D28294662: [pytorch][PR] add cuda memory and distributed metadata
Test Plan: revert-hammer
Differential Revision:
D28294662 (https://github.com/pytorch/pytorch/commit/98fcdb80059ddd9ab280f5f3051db5d08975574f)
Original commit changeset: 3c71ffa333e3
fbshipit-source-id: 7c96e13b227fe0dff60ccb1c57cfd6790f8591b7