Assert weight_observer has the correct dtype
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/24436
Test Plan: Imported from OSS
Differential Revision: D16847141
Pulled By: jamesr66a
fbshipit-source-id: 1dde5c26449115b53e71d410b41204d743787c44
