Align settings for new device key. (#98224)
Summary: As title.
Test Plan: All CI tests should pass.
Reviewed By: yuhc
Differential Revision: D44341331
Pull Request resolved: https://github.com/pytorch/pytorch/pull/98224
Approved by: https://github.com/jackm321, https://github.com/ezyang
