Add support for non-persistent buffers. (#37191)
Summary:
Issue: https://github.com/pytorch/pytorch/issues/18056
Pull Request resolved: https://github.com/pytorch/pytorch/pull/37191
Differential Revision: D21428373
Pulled By: albanD
fbshipit-source-id: a7d367bafb95137e1bc380178b82b08eff5d5a5a
