Add device id to ConvolutionParams (#50892)
Summary:
Fixes https://github.com/pytorch/pytorch/issues/50844
Pull Request resolved: https://github.com/pytorch/pytorch/pull/50892
Reviewed By: mruberry
Differential Revision: D27703874
Pulled By: ngimel
fbshipit-source-id: aefa4f44ca3387c2f7aa06136e5c62d66a4ac6ab