Revert D35284563: Use the same checks in all `grid_sampler` functions
Test Plan: revert-hammer
Differential Revision:
D35284563 (https://github.com/pytorch/pytorch/commit/835cc66e5dd26db558931b4fe47b45e08a3a09f7)
Original commit changeset: 1477c506b875
Original Phabricator Diff: D35284563 (https://github.com/pytorch/pytorch/commit/835cc66e5dd26db558931b4fe47b45e08a3a09f7)
fbshipit-source-id: 7260f4dfda23bd60200e5ba2c5bf3e4f833c2646
(cherry picked from commit fbe082905ef678e7dd70dbc9520dca644383ce01)
