Make the model robust to accept Lazy device (#646)
Summary:
This commit makes the moco model robust to accept Lazy devices.
Pull Request resolved: https://github.com/pytorch/benchmark/pull/646
Test Plan: CI.
Reviewed By: xuzhao9
Differential Revision: D33080378
Pulled By: alanwaketan
fbshipit-source-id: c30e13175f53ce4b944d6bfcae35ed55c2a1f806
