Support fallback for more operators (#16566)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/16566
it's a follow-up to https://github.com/pytorch/pytorch/pull/16456
Reviewed By: yinghai
Differential Revision: D13881462
fbshipit-source-id: eff063580ac8f622477417ed4b25320299451811
