Only allow hub.load() from original repo. (#54451)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/54451
Test Plan: Imported from OSS
Reviewed By: nikithamalgifb
Differential Revision: D27243825
Pulled By: ailzhang
fbshipit-source-id: 2f65a82064d83b71224b4280ddfaabfa8ec9aec3
