Disable CPU device on torchrec_dlrm (#1501)
Summary:
The CI is broken because of an upstream pytorch issue: https://github.com/pytorch/pytorch/issues/97308
Disable CPU device for now.
Pull Request resolved: https://github.com/pytorch/benchmark/pull/1501
Reviewed By: weiwangmeta
Differential Revision: D44308658
Pulled By: xuzhao9
fbshipit-source-id: a9f9952a319c7c8cb980078b1c16a8c2ccea1bb5