Revert D28474983: Set streams when invoking UDFs
Test Plan: revert-hammer
Differential Revision:
D28474983 (https://github.com/pytorch/pytorch/commit/ab1e958d2021a100d05e38d23da04da85b223ac9)
Original commit changeset: 358292764d0a
fbshipit-source-id: b4d4c25fe551d83848a9d023c139a9f1acc4c23d