Bugfix for fusion device check (#19594)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/19594
I missed a callsite
Reviewed By: wanchaol
Differential Revision: D15041457
fbshipit-source-id: eef76ad51bee06a56d31b4ab64f19250fe2ad8f0
