Add forward compatability tests in CI (#64139)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/64139
Test Plan: Imported from OSS
Reviewed By: mruberry
Differential Revision: D30626912
Pulled By: tugsbayasgalan
fbshipit-source-id: 781a88386701b42e2e86daaca0a779d1fc1c4df3
