Add and test training in lite interpreter. (#32359)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/32359
Test Plan: Imported from OSS
Differential Revision: D19450614
Pulled By: iseeyuan
fbshipit-source-id: 6bafff39d7880a5b7fb9cd70c33a4e584812be12
