Back out "Revert D30745960: [DDP] Remove SPMD from self.modules_buffers" (#64778)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/64778
Original commit changeset: d3f3fb813c45
ghstack-source-id: 138326910
Test Plan: ci
Reviewed By: H-Huang
Differential Revision: D30849443
fbshipit-source-id: 15dab8a959a29d2e2fefac6ad52b8d8168eacc02
