Re-enable CPU device on torchrec_dlrm (#1503)
Summary:
Fixes https://github.com/pytorch/benchmark/issues/1502
Pull Request resolved: https://github.com/pytorch/benchmark/pull/1503
Reviewed By: weiwangmeta
Differential Revision: D44347906
Pulled By: xuzhao9
fbshipit-source-id: bb14658ee2216036e9506f222d1c0d7588897f9b
