remove asserts when selecting cuda device (#1585)
Summary:
We do not want model code to mess with global device stuff
Pull Request resolved: https://github.com/pytorch/benchmark/pull/1585
Reviewed By: xuzhao9
Differential Revision: D45330380
Pulled By: janeyx99
fbshipit-source-id: fcf940c6dd8c2a0dc19d89cd605ebf1b4c390dd6
